-- Logs begin at Sat 2022-09-03 03:10:30 UTC, end at Sat 2022-09-03 04:10:13 UTC. -- Sep 03 03:35:17.214655 dv-cinder-799663-12-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 03:35:17 2022] *** Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: nodename: dv-cinder-799663-12-smb Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: machine: x86_64 Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: clock source: unix Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: pcre jit disabled Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: detected number of CPU cores: 4 Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: current working directory: / Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: detected binary path: /usr/bin/uwsgi-core Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: your processes number limit is 47680 Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: your memory page size is 4096 bytes Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: detected max file descriptor number: 2048 Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: lock engine: pthread robust mutexes Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: thunder lock: enabled Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 03 03:35:17.228936 dv-cinder-799663-12-smb devstack@keystone.service[87924]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 03:35:17.266373 dv-cinder-799663-12-smb devstack@keystone.service[87924]: Python main interpreter initialized at 0x5635dc56a9c0 Sep 03 03:35:17.266373 dv-cinder-799663-12-smb devstack@keystone.service[87924]: python threads support enabled Sep 03 03:35:17.266373 dv-cinder-799663-12-smb devstack@keystone.service[87924]: your server socket listen backlog is limited to 100 connections Sep 03 03:35:17.266373 dv-cinder-799663-12-smb devstack@keystone.service[87924]: your mercy for graceful operations on workers is 90 seconds Sep 03 03:35:17.266808 dv-cinder-799663-12-smb devstack@keystone.service[87924]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 03:35:17.266808 dv-cinder-799663-12-smb devstack@keystone.service[87924]: *** Operational MODE: preforking *** Sep 03 03:35:17.267118 dv-cinder-799663-12-smb devstack@keystone.service[87924]: *** uWSGI is running in multiple interpreter mode *** Sep 03 03:35:17.267118 dv-cinder-799663-12-smb devstack@keystone.service[87924]: spawned uWSGI master process (pid: 87924) Sep 03 03:35:17.267369 dv-cinder-799663-12-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 03 03:35:17.272961 dv-cinder-799663-12-smb devstack@keystone.service[87924]: spawned uWSGI worker 1 (pid: 87938, cores: 1) Sep 03 03:35:17.272961 dv-cinder-799663-12-smb devstack@keystone.service[87924]: spawned uWSGI worker 2 (pid: 87939, cores: 1) Sep 03 03:35:17.272961 dv-cinder-799663-12-smb devstack@keystone.service[87924]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 03:35:21.498140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:35:21.498140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: from cryptography.utils import int_from_bytes Sep 03 03:35:21.498983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:35:21.498983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: from cryptography.utils import int_from_bytes Sep 03 03:35:21.499417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:35:21.499417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: from cryptography.utils import int_from_bytes Sep 03 03:35:21.499906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 03:35:21.499906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: from cryptography.utils import int_from_bytes Sep 03 03:35:21.548219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 03:35:21.548423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 03:35:21.548555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] command line args: [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 03:35:21.548857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 03:35:21.549045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ================================================================================ {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 03:35:21.549332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 03:35:21.549470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] admin_token = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.549550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 03:35:21.549611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] config_dir = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.549673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] command line args: [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 03:35:21.549735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.549892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] config_source = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.549975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 03:35:21.550108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] debug = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.550246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ================================================================================ {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 03:35:21.550331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.550534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] admin_token = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.550604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] config_dir = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.550666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.550723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.550843 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.550916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] config_source = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] debug = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] list_limit = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] log_config_append = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.551956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] log_dir = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] log_file = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] list_limit = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] log_config_append = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.552863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] log_dir = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] log_file = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.553982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.554963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.555955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.556364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.556559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] publish_errors = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.556696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.556775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] publish_errors = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.557916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] standard_threads = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558326 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] use_journal = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] use_json = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.558983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] standard_threads = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] use_stderr = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] use_syslog = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.559846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] use_journal = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.559961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.560041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] use_json = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.560138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] use_stderr = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.560215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.560289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] use_syslog = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.560449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.560529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 03:35:21.560702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.560781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.560956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.561952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.562986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.563940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.564950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565225 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.565932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.566905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.567843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.568966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.569985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.570888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.571044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.571129 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.571273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.571346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.571548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.571636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.571861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.572070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.572152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.572339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.572586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.572706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.572825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.572931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.573919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.574990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.575929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.576887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.577961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.578133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.578218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.578372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.578448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.578606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.578686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.578843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.579870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580115 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.580832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.581971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.582990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.583921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.584846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] auth.external = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.585996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] auth.password = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] auth.token = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.586973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] auth.external = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.587071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.587265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.587342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.587519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.587757 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.587832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] auth.password = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] auth.token = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] credential.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.588995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.589968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] credential.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.590919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.591979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.592148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.592224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.592403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.592481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.592644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.592720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.592881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.593963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.594943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.595903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.596851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.597849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598238 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598552 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.598943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.599915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.600988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.601945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.602949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.603918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.604871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.605866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.606952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.607925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.608980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.609929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.610086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.610163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.610325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.610409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.610565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.610642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.610807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.611200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.611365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.611451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.611616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.611692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.611857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.611932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.612886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613312 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.613871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.614987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.615935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.616973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.617956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.618112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.618188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.618392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.618514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.618650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.618891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] role.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.619907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] role.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.620858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] role.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.621857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] role.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.622985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.623965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.624123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.624199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.624378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.624455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.624636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.624720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.624889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625027 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.625911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.626873 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.627861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628340 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.628986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.629956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630896 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.630970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.631929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.632898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.connection = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.633894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.634081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.634159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.634323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.634563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.634705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.634790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.634983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.connection = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.635974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.636931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.637010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.637174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.637251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.637343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 03:35:21.637419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.637649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.637902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.638141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.638391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.638630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.638878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.639111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.639353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.639589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 03:35:21.639806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 03:35:21.667109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.667337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.667569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.668294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.668531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.668760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.675975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.677076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.704266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.704478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.705491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.705729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.758676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.759691 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.807043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.807301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.808786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.809055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.963954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.964159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.964391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.964624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.964813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.964905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.965087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.965210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.965287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.965525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.965747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.965968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.988689 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.988824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.989835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.990026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:21.990205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.001516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.001837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.014530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.014660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.014876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.014979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.015884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.016003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.016170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 03:35:22.032586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.032769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.032898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 03:35:22.032994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 03:35:22.033163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.033350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.033443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 03:35:22.033549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 03:35:22.033636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.033852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.033988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.034069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.034143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.034361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.034485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.034591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.044247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.044536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.044816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.044973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.045098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.045201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.045408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.045693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.052128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.052632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.055071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.055361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.055521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.055615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.055837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.055997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.056305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.056538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.056662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.056797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.056876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.057146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.057298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.057435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.057516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.057676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.057776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.057948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.058033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.058234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.058513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.058787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.080710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.082083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.082223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.082491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.083563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.083848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.087202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.087493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.087781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.088715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.089030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.089322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.094193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.094489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.095760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.096054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.100149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.100455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.100752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.101063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.101344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.101623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.101745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.101889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.102080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.102170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.102344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.102657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.103475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.103771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.104052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.104327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.118185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.118513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.120258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.120540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.122406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.124367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.125691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.125999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.127567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.127870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.130290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.132017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.133446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.135287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.136813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.137142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.137439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.137740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.138027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.138327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.138657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.138962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.139252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.139546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.139856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.140110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.154206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.154499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.154787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.155056 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.156358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.156655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.156939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.157217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.162417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.163548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.164080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.165128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.165448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.166339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.168042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.168230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.168311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.168553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.168841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.169140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.169589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.171020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.171321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.171615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.171901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.172287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.180786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.181233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.181590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.181878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.182276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.182549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.182838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.184194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.184484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.184770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.185082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.185467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.185751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.186076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.200307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.202145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.203237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.205072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.206178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.207616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.207944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.209201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.209411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.209595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.209875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.210880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.211164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.211563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.216365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.217879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.218255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.219701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.220769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.221202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.221497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.221780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.222608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.223006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.223313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.223600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.229765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.230072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.230371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.231950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.232244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.232526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.237712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.238007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.238295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.238579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.238873 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.239158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.239440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.239717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.239854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 03:35:22.240017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.240194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.240337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.240484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.240619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.240750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.240872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.241015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.241143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.241269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.241446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.241573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.241697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.241851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.242143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.242431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.242704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.242971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.243242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 03:35:22.275846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635dc56a9c0 pid: 87938 (default app) Sep 03 03:35:22.279192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e80241-e275-477e-975d-336594e3664d None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:22.279431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635dc56a9c0 pid: 87939 (default app) Sep 03 03:35:22.279529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e80241-e275-477e-975d-336594e3664d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:22.279743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e80241-e275-477e-975d-336594e3664d None None] PATH_INFO: `/v3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:22.283978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Sat Sep 3 03:35:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:28.865225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed92c-aa02-48cc-9ec9-4400a60c8b13 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:28.866043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed92c-aa02-48cc-9ec9-4400a60c8b13 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:28.866043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed92c-aa02-48cc-9ec9-4400a60c8b13 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:28.873967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:28 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:28.882765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:28.883626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:28.883626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:28.954606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: INFO dbcounter [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] Registered counter for database keystone Sep 03 03:35:28.975698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG oslo_db.sqlalchemy.engines [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:35:28.983994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writer thread running {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:35:29.167489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG passlib.handlers.bcrypt [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87938) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 03:35:29.167877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG passlib.handlers.bcrypt [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87938) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 03:35:29.227122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:29.228954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:29.367942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 03:35:29.666481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ed92c-aa02-48cc-9ec9-4400a60c8b13 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:29.741687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: INFO dbcounter [None req-3a2ed92c-aa02-48cc-9ec9-4400a60c8b13 None None] Registered counter for database keystone Sep 03 03:35:29.767181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG oslo_db.sqlalchemy.engines [None req-3a2ed92c-aa02-48cc-9ec9-4400a60c8b13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 03:35:29.775042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writer thread running {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 03:35:29.893497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ed92c-aa02-48cc-9ec9-4400a60c8b13 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:29.901666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61a9b5-23ea-48fe-a32b-cb4d60646a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:29.902306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a9b5-23ea-48fe-a32b-cb4d60646a0d admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:29.902589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a9b5-23ea-48fe-a32b-cb4d60646a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:29.902862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a9b5-23ea-48fe-a32b-cb4d60646a0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:29.912295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61a9b5-23ea-48fe-a32b-cb4d60646a0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:29.968405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6f61a9b5-23ea-48fe-a32b-cb4d60646a0d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 03:35:29.968640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61a9b5-23ea-48fe-a32b-cb4d60646a0d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:29.979535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Sep 3 03:35:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:35:29.985930 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:30.001390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083c304-cb5e-4287-8b97-8141bfad9dc8 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:30.006378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb64af-4125-4aa7-ac4c-17eb565f16a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:30.007516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb64af-4125-4aa7-ac4c-17eb565f16a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:30.007797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb64af-4125-4aa7-ac4c-17eb565f16a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:30.008076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb64af-4125-4aa7-ac4c-17eb565f16a8 admin admin] PATH_INFO: `/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:30.009797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb64af-4125-4aa7-ac4c-17eb565f16a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=b003f3768dcc465bb9a5bba73f3a6b18)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:30.062091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7bdb64af-4125-4aa7-ac4c-17eb565f16a8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 03:35:30.062431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb64af-4125-4aa7-ac4c-17eb565f16a8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:30.067085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Sat Sep 3 03:35:29 2022] GET /identity/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:31.913217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e2a9-b498-4092-98b0-1eedd2996826 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:31.914087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e2a9-b498-4092-98b0-1eedd2996826 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:31.914087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41e2a9-b498-4092-98b0-1eedd2996826 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:31.918826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:31.924601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0ff7-5912-445f-8597-87546e72e7e1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:31.925061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0ff7-5912-445f-8597-87546e72e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:31.925152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac0ff7-5912-445f-8597-87546e72e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:31.945762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-acac0ff7-5912-445f-8597-87546e72e7e1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:31.947345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-acac0ff7-5912-445f-8597-87546e72e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:31.955722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 03:35:32.221958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41e2a9-b498-4092-98b0-1eedd2996826 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:32.236687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41e2a9-b498-4092-98b0-1eedd2996826 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:32.242194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ea357-ea85-43db-815f-7391d6076400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:32.242792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea357-ea85-43db-815f-7391d6076400 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:32.243074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea357-ea85-43db-815f-7391d6076400 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:32.243432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea357-ea85-43db-815f-7391d6076400 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:32.252326 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ea357-ea85-43db-815f-7391d6076400 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:32.254136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ea357-ea85-43db-815f-7391d6076400 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:32.264007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Sat Sep 3 03:35:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:35:32.269788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac0ff7-5912-445f-8597-87546e72e7e1 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:32.279251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac0ff7-5912-445f-8597-87546e72e7e1 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:32.285928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fdb28-f235-485a-9261-824378e76109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:32.286568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdb28-f235-485a-9261-824378e76109 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:32.286849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdb28-f235-485a-9261-824378e76109 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:32.287125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdb28-f235-485a-9261-824378e76109 admin admin] PATH_INFO: `/v3/users/5c585d4ca5124180a1443dfe66cd6371` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:32.288702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fdb28-f235-485a-9261-824378e76109 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c585d4ca5124180a1443dfe66cd6371)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:32.290823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fdb28-f235-485a-9261-824378e76109 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:32.292415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Sat Sep 3 03:35:32 2022] GET /identity/v3/users/5c585d4ca5124180a1443dfe66cd6371 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:34.235816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc9f2b-38be-4f86-8d80-fe4f70305497 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:34.236668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc9f2b-38be-4f86-8d80-fe4f70305497 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:34.236668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc9f2b-38be-4f86-8d80-fe4f70305497 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:34.238100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:34.243376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57fce-6d30-4c1b-9dbe-b582ca520e1a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:34.244226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57fce-6d30-4c1b-9dbe-b582ca520e1a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:34.244517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e57fce-6d30-4c1b-9dbe-b582ca520e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:34.264157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-52e57fce-6d30-4c1b-9dbe-b582ca520e1a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:34.265372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-52e57fce-6d30-4c1b-9dbe-b582ca520e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:34.289311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8381c-747e-400c-9b67-7f33d40686d4 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:34.289592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8381c-747e-400c-9b67-7f33d40686d4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:34.289867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8381c-747e-400c-9b67-7f33d40686d4 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:34.291387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:35:34.296329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:34.296614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:34.296894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:34.341825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG passlib.handlers.bcrypt [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87939) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 03:35:34.342207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG passlib.handlers.bcrypt [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87939) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 03:35:34.348879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:34.391336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:34.392953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:34.495371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:35:34.612193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e57fce-6d30-4c1b-9dbe-b582ca520e1a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:34.639570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:34.721841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e57fce-6d30-4c1b-9dbe-b582ca520e1a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:34.756154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:34.757023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:34.757301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:34.757407 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:34.757569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:34.769036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:34.778169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:34.779078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:34.780286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:34.785944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:34.861621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b6c69-84ef-4488-9162-580c55f83311 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:34.863955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:34.868121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:34.887990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cbfa1-81ed-4fd1-9d66-5eca21977083 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:34.899217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:34.900113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:34.900393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:34.900666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:34.922901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:34.923508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:34.923790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:34.924066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:34.924739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:34.925076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:34.926516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:34.938410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:35:34.943927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:34.967033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:34.968563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:35.042699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771f6e4-688d-439b-b9dc-e661d5279968 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:35.067073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:35:35.073145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:35.075877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:35.077916 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:35.078563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:35.078872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:35.079142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] PATH_INFO: `/v3/users/5c585d4ca5124180a1443dfe66cd6371` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:35.080298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] RBAC: Authorizing `identity:get_user(user_id=5c585d4ca5124180a1443dfe66cd6371)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:35.081796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:35.083367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:34 2022] GET /identity/v3/users/5c585d4ca5124180a1443dfe66cd6371 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:35:35.089557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:35.105372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:35.172899 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aef3b-bc1c-4be9-a0b0-c9d22a930313 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:35.193899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035751b-5c8b-44ff-86d1-755484e39b27 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:35.208068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:35.208938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:35.209249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:35.209522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:35.226923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:35.227569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:35.227850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:35.228048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:35.228175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:35.229378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:35.229503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:35.230788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:35.232323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:35.238505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:35:35.248284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:35.249585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:35:35.250364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:35:35.250364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:35:35.250364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:35:35.250364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:35:35.255288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:35.312336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:35.320065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:35.339624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79999211-9239-4b3d-9904-38de6a5a1ce7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:35.360146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea6914-b855-47cd-b3ad-b82cb08b5c81 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:35.376340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11738b84-a6d4-4a79-9847-4841af821154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:35.376972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738b84-a6d4-4a79-9847-4841af821154 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:35.377250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738b84-a6d4-4a79-9847-4841af821154 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:35.377520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11738b84-a6d4-4a79-9847-4841af821154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:35.378281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11738b84-a6d4-4a79-9847-4841af821154 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.domain.id=default, user.id=5c585d4ca5124180a1443dfe66cd6371) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:35.378583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11738b84-a6d4-4a79-9847-4841af821154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:35.380068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11738b84-a6d4-4a79-9847-4841af821154 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:35.387350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1322 bytes} [Sat Sep 3 03:35:35 2022] GET /identity/v3/role_assignments?user.id=5c585d4ca5124180a1443dfe66cd6371&scope.domain.id=default&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:35:35.395913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b2785-5e19-459d-8a07-fea9cc0a69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:35.396665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2785-5e19-459d-8a07-fea9cc0a69ed None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:35.397051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2785-5e19-459d-8a07-fea9cc0a69ed None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:35.397389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2785-5e19-459d-8a07-fea9cc0a69ed None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:35.398113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b2785-5e19-459d-8a07-fea9cc0a69ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:35.398441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b2785-5e19-459d-8a07-fea9cc0a69ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:35.400081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b2785-5e19-459d-8a07-fea9cc0a69ed None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:35.420366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 10/21] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:35:37.354764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2323-a1cf-433d-a210-c3221c3cf454 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.355267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2323-a1cf-433d-a210-c3221c3cf454 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.355337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2323-a1cf-433d-a210-c3221c3cf454 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:37.356980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 12/22] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:37.362757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297ea1-ca1d-4db0-81f1-682e33520b74 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.363574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297ea1-ca1d-4db0-81f1-682e33520b74 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.364066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297ea1-ca1d-4db0-81f1-682e33520b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:37.401974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1d297ea1-ca1d-4db0-81f1-682e33520b74 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:37.403575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1d297ea1-ca1d-4db0-81f1-682e33520b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:37.495583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:35:37.833129 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea26c-5117-4105-bcd9-224f1ce71ec8 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.833821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea26c-5117-4105-bcd9-224f1ce71ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.834287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea26c-5117-4105-bcd9-224f1ce71ec8 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:37.835828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:37.841184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286b93-1308-4696-8204-f34254fc9ccd None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.841687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286b93-1308-4696-8204-f34254fc9ccd None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.842160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a286b93-1308-4696-8204-f34254fc9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:37.860701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2a286b93-1308-4696-8204-f34254fc9ccd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:37.862505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2a286b93-1308-4696-8204-f34254fc9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:37.905952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:37.929996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a418e8-f22e-441d-be04-7dc3fd30178c None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.930658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a418e8-f22e-441d-be04-7dc3fd30178c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.931187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a418e8-f22e-441d-be04-7dc3fd30178c None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:37.932721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 14/25] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:35:37.937764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284f88-66b1-4cd3-9d65-6251282b456f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.938260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284f88-66b1-4cd3-9d65-6251282b456f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.938713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284f88-66b1-4cd3-9d65-6251282b456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:37.943768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 12/26] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:37.962025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d5284f88-66b1-4cd3-9d65-6251282b456f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:37.963620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d5284f88-66b1-4cd3-9d65-6251282b456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:37.983692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077c08-6d41-45ad-8047-c763578f6bd1 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.984372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077c08-6d41-45ad-8047-c763578f6bd1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.984875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f077c08-6d41-45ad-8047-c763578f6bd1 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:37.986755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:35:37.992073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f484b4-d30d-4b3b-ba03-e212d84d3ed2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:37.992585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f484b4-d30d-4b3b-ba03-e212d84d3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:37.993068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f484b4-d30d-4b3b-ba03-e212d84d3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:38.025788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-57f484b4-d30d-4b3b-ba03-e212d84d3ed2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:38.027376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-57f484b4-d30d-4b3b-ba03-e212d84d3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:38.076451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 15/28] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:35:38.079850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284f88-66b1-4cd3-9d65-6251282b456f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:38.171463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 14/29] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:35:38.222314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:38.254959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284f88-66b1-4cd3-9d65-6251282b456f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:38.303040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:38.303871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:38.304266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:38.304547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:38.326052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:38.331250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:38.332165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:38.332886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 16/30] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:35:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:38.338582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f484b4-d30d-4b3b-ba03-e212d84d3ed2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:38.360220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:38.492525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f484b4-d30d-4b3b-ba03-e212d84d3ed2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:38.501051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:38.546009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:38.546975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:38.547974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:38.548579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:38.550398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:38.550927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:38.552065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd404ced-e8d5-402a-811d-e58604b9a252 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:38.555168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:38.576648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 15/31] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:38.577783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:38.636410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:38.637436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:38.637923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:38.638375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:38.640998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:38.654688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:38.656198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:35:38.674771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:38.675688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:35:38.676461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:35:38.676461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:35:38.676461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:38.678258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 17/32] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:35:38.679316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:38.715871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126f5d9-b4ce-4b72-b2f5-1d86b48eb69e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:38.750762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:38.751726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:38.752210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:38.752881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:38.753901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:38.755476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:38.806514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e88dc-0fa3-45d9-83fc-45827581a5d0 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:38.845262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:38.846200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:38.846666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:38.847075 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] PATH_INFO: `/v3/users/5c585d4ca5124180a1443dfe66cd6371` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:38.848382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] RBAC: Authorizing `identity:get_user(user_id=5c585d4ca5124180a1443dfe66cd6371)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:38.850117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:38.851935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 18/33] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:38 2022] GET /identity/v3/users/5c585d4ca5124180a1443dfe66cd6371 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:38.853038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:38.908988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 16/34] 10.222.0.13 () {60 vars in 1131 bytes} [Sat Sep 3 03:35:38 2022] POST /identity/v3/roles => generated 225 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:38.910302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:38.920908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:38.953332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:39.020344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c3d98-d7ab-4474-acfd-efdfe0c1d696 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:39.045846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209a576-a3d5-4194-a192-da164174b1ba None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:39.105365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:39.106446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.108059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.108490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.110441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:39.112338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:39.123595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:39.124479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.124760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.125071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.125795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:39.126101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:39.128553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:39.146919 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 17/35] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:39.148083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:39.252604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:39.266604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 19/36] 10.222.0.13 () {60 vars in 1131 bytes} [Sat Sep 3 03:35:38 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:39.267550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:39.273311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63244b8-ad1e-43f0-b768-12b65be75511 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:39.325161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b104e-aeb3-4001-9e86-9a53390ab0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:39.325827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b104e-aeb3-4001-9e86-9a53390ab0c8 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.326115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b104e-aeb3-4001-9e86-9a53390ab0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.326394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b104e-aeb3-4001-9e86-9a53390ab0c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.327982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b104e-aeb3-4001-9e86-9a53390ab0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:39.329575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b104e-aeb3-4001-9e86-9a53390ab0c8 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:39.331318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 18/37] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:39.332756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ecc67-997c-49f5-b238-f94dd34c1b34 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.333078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ecc67-997c-49f5-b238-f94dd34c1b34 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.333359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ecc67-997c-49f5-b238-f94dd34c1b34 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.338875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 19/38] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:39.338875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907f947-ec43-4e5a-b9ff-ad9be4c5f01d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.338875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907f947-ec43-4e5a-b9ff-ad9be4c5f01d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.338875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907f947-ec43-4e5a-b9ff-ad9be4c5f01d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.338875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 20/39] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:39.341869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907f947-ec43-4e5a-b9ff-ad9be4c5f01d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:39.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a9986-a040-4436-b99b-a33faf3adf9f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:39.412241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:39.441011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44b501-f63b-43c4-947f-212dd62c700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:39.442008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b501-f63b-43c4-947f-212dd62c700f None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.442515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b501-f63b-43c4-947f-212dd62c700f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.442858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b501-f63b-43c4-947f-212dd62c700f None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.443532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44b501-f63b-43c4-947f-212dd62c700f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:39.445255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44b501-f63b-43c4-947f-212dd62c700f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:39.469139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907f947-ec43-4e5a-b9ff-ad9be4c5f01d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:39.479925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:35:39 2022] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:39.481909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc25e14-2aa6-44f6-9e8a-b6bb95748fca None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.482198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc25e14-2aa6-44f6-9e8a-b6bb95748fca None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.482475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc25e14-2aa6-44f6-9e8a-b6bb95748fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.505561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3b769-094a-40c7-80d8-df941b84ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:39.506251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b769-094a-40c7-80d8-df941b84ffdd None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.506538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b769-094a-40c7-80d8-df941b84ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.506820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3b769-094a-40c7-80d8-df941b84ffdd None admin] PATH_INFO: `/v3/domains/default/users/5c585d4ca5124180a1443dfe66cd6371/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.509383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3b769-094a-40c7-80d8-df941b84ffdd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c585d4ca5124180a1443dfe66cd6371, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:39.509970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ccc25e14-2aa6-44f6-9e8a-b6bb95748fca None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:39.510925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3b769-094a-40c7-80d8-df941b84ffdd None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:39.512084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ccc25e14-2aa6-44f6-9e8a-b6bb95748fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:39.530037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 21/41] 10.222.0.13 () {58 vars in 1361 bytes} [Sat Sep 3 03:35:39 2022] PUT /identity/v3/domains/default/users/5c585d4ca5124180a1443dfe66cd6371/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:35:39.539476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227e9a-0450-4506-9530-c2dee5ed5a40 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:39.540447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227e9a-0450-4506-9530-c2dee5ed5a40 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:39.543353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21227e9a-0450-4506-9530-c2dee5ed5a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:39.572053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-21227e9a-0450-4506-9530-c2dee5ed5a40 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:39.575347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-21227e9a-0450-4506-9530-c2dee5ed5a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:39.595153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:39.599779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 21/42] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:39.670252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:39.872362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc25e14-2aa6-44f6-9e8a-b6bb95748fca None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:39.947830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21227e9a-0450-4506-9530-c2dee5ed5a40 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:40.057231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21227e9a-0450-4506-9530-c2dee5ed5a40 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:40.079207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:40.086806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc25e14-2aa6-44f6-9e8a-b6bb95748fca None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:40.094666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:40.094845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:40.096747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:40.096747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:40.096747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:40.099001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:40.100615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 23/44] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:40.106431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:40.123004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:40.133433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248c9a6-48df-442f-b227-8c789038e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:40.134444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248c9a6-48df-442f-b227-8c789038e175 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:40.134928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248c9a6-48df-442f-b227-8c789038e175 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:40.135348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248c9a6-48df-442f-b227-8c789038e175 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:40.136282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248c9a6-48df-442f-b227-8c789038e175 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:40.137953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248c9a6-48df-442f-b227-8c789038e175 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:40.165184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1131 bytes} [Sat Sep 3 03:35:39 2022] POST /identity/v3/roles => generated 223 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:40.247373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d8456-3e24-4902-8093-d97d975653d6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:40.286416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee79df-b407-4aba-950b-480b148b7155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:40.287413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee79df-b407-4aba-950b-480b148b7155 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:40.287893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee79df-b407-4aba-950b-480b148b7155 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:40.288418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee79df-b407-4aba-950b-480b148b7155 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:40.289337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee79df-b407-4aba-950b-480b148b7155 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:40.291112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee79df-b407-4aba-950b-480b148b7155 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:40.329628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:35:40 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:35:41.511288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129998-f191-4f7d-a72d-d5105a14886b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:41.511799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129998-f191-4f7d-a72d-d5105a14886b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:41.511799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129998-f191-4f7d-a72d-d5105a14886b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:41.513111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 23/47] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:41.518529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e134-b79f-4733-a724-60adcb52aae2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:41.518977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e134-b79f-4733-a724-60adcb52aae2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:41.519052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5e134-b79f-4733-a724-60adcb52aae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:41.538144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d8e5e134-b79f-4733-a724-60adcb52aae2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:41.539341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d8e5e134-b79f-4733-a724-60adcb52aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:41.602958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:41.612496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:35:41.885467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22129998-f191-4f7d-a72d-d5105a14886b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:41.991254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22129998-f191-4f7d-a72d-d5105a14886b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:42.026093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:42.026723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.027003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.027271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.037820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:42.042719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:42.043571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:42.044321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 24/49] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:42.049760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5e134-b79f-4733-a724-60adcb52aae2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:42.158003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5e134-b79f-4733-a724-60adcb52aae2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:42.200596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d72a46-918a-4d79-8a7c-6a98d914363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:42.201242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d72a46-918a-4d79-8a7c-6a98d914363f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.201529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d72a46-918a-4d79-8a7c-6a98d914363f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.201805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d72a46-918a-4d79-8a7c-6a98d914363f None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.202471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d72a46-918a-4d79-8a7c-6a98d914363f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:42.202778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d72a46-918a-4d79-8a7c-6a98d914363f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:42.204167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d72a46-918a-4d79-8a7c-6a98d914363f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:42.217778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 26/50] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:42.219578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:42.239354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:42.253925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b2b6-d400-4548-84c2-ec303530441a None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.254231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b2b6-d400-4548-84c2-ec303530441a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.254484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b2b6-d400-4548-84c2-ec303530441a None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.255829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 27/51] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:35:42.261683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170537d-d789-4e63-beae-7eab2c13f5d2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.261968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170537d-d789-4e63-beae-7eab2c13f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.262243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170537d-d789-4e63-beae-7eab2c13f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.331872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49a7a2-bd5e-4950-929d-f7d265a7cccc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:42.369974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:42.370623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.370902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.371177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] PATH_INFO: `/v3/users/5c585d4ca5124180a1443dfe66cd6371` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.372395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] RBAC: Authorizing `identity:get_user(user_id=5c585d4ca5124180a1443dfe66cd6371)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:42.373918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:42.375503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 25/52] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:42 2022] GET /identity/v3/users/5c585d4ca5124180a1443dfe66cd6371 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:35:42.381314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:42.390103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8170537d-d789-4e63-beae-7eab2c13f5d2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:42.391318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8170537d-d789-4e63-beae-7eab2c13f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:42.445468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:42.459511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 28/53] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:35:42.469659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:42.485780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6cee-cf3d-430e-b9f7-91fe04538726 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:42.520805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:42.521473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.521753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.522029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.523180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:42.524823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:42.526591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 26/54] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:42.532469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170537d-d789-4e63-beae-7eab2c13f5d2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:42.648771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170537d-d789-4e63-beae-7eab2c13f5d2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:42.683982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:42.684609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.684888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.685193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.685930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.domain.id=default, user.id=5c585d4ca5124180a1443dfe66cd6371) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:42.686242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:42.687701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:42.696508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 29/55] 10.222.0.13 () {56 vars in 1322 bytes} [Sat Sep 3 03:35:42 2022] GET /identity/v3/role_assignments?user.id=5c585d4ca5124180a1443dfe66cd6371&scope.domain.id=default&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:42.733289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:42.849221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b797e-3d76-4057-a791-c6beda3c0b03 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:42.885133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc2027-8bc3-4730-9aac-85a705a9242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:42.885760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc2027-8bc3-4730-9aac-85a705a9242f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:42.886041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc2027-8bc3-4730-9aac-85a705a9242f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:42.886313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc2027-8bc3-4730-9aac-85a705a9242f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:42.887422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc2027-8bc3-4730-9aac-85a705a9242f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:42.888894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc2027-8bc3-4730-9aac-85a705a9242f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:42.890489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 27/56] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:42.896137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:42.948987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:42.997735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2bd48-8259-45dd-864b-f39ecd85c02e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:43.036233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f738961-bc59-4263-afbb-4a58888bdb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:43.036842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738961-bc59-4263-afbb-4a58888bdb8e None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:43.037158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738961-bc59-4263-afbb-4a58888bdb8e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:43.037435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738961-bc59-4263-afbb-4a58888bdb8e None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:43.038097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f738961-bc59-4263-afbb-4a58888bdb8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:43.039553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f738961-bc59-4263-afbb-4a58888bdb8e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:43.068698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 30/57] 10.222.0.13 () {60 vars in 1140 bytes} [Sat Sep 3 03:35:42 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:45.059376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e3f8c-2d0c-4adb-9d6a-9aac61cd122c None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:45.059971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e3f8c-2d0c-4adb-9d6a-9aac61cd122c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:45.059971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e3f8c-2d0c-4adb-9d6a-9aac61cd122c None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:45.061296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 28/58] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:45.068773 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d025-a7de-4de8-a4be-df1f02e1d829 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:45.069253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d025-a7de-4de8-a4be-df1f02e1d829 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:45.069360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0d025-a7de-4de8-a4be-df1f02e1d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:45.091312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3bc0d025-a7de-4de8-a4be-df1f02e1d829 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:45.092517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3bc0d025-a7de-4de8-a4be-df1f02e1d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:45.173349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 31/59] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:45.442666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e3f8c-2d0c-4adb-9d6a-9aac61cd122c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:45.467542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:45.565332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e3f8c-2d0c-4adb-9d6a-9aac61cd122c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:45.610242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bd6a7-dda5-4e44-956d-0125c1744cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:45.610886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd6a7-dda5-4e44-956d-0125c1744cda None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:45.611467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd6a7-dda5-4e44-956d-0125c1744cda None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:45.611766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd6a7-dda5-4e44-956d-0125c1744cda None admin] PATH_INFO: `/v3/domains/default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:45.613055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bd6a7-dda5-4e44-956d-0125c1744cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:45.614550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bd6a7-dda5-4e44-956d-0125c1744cda None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:45.616244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 29/60] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:45.626273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d025-a7de-4de8-a4be-df1f02e1d829 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:45.679110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:45.759070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0d025-a7de-4de8-a4be-df1f02e1d829 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:45.801351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ea311-8142-4f1b-98c6-ef5a74ca44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:45.801955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea311-8142-4f1b-98c6-ef5a74ca44dc None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:45.802235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea311-8142-4f1b-98c6-ef5a74ca44dc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:45.802506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea311-8142-4f1b-98c6-ef5a74ca44dc None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:45.803155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ea311-8142-4f1b-98c6-ef5a74ca44dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:45.804707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ea311-8142-4f1b-98c6-ef5a74ca44dc None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:45.835231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 32/61] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:35:45 2022] POST /identity/v3/users => generated 275 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:48.909669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab48ba-3f50-4c94-96f9-301a74f642cb None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:48.910182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab48ba-3f50-4c94-96f9-301a74f642cb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:48.910252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab48ba-3f50-4c94-96f9-301a74f642cb None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:48.911756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 30/62] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:48.917329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6c3c-7a74-4500-a2aa-c94b0d93c998 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:48.917726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6c3c-7a74-4500-a2aa-c94b0d93c998 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:48.917922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b6c3c-7a74-4500-a2aa-c94b0d93c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:48.947312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a74b6c3c-7a74-4500-a2aa-c94b0d93c998 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:48.948546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a74b6c3c-7a74-4500-a2aa-c94b0d93c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:49.015322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba52c97-0d2e-435e-9b66-7353d09fe6bf None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.015962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba52c97-0d2e-435e-9b66-7353d09fe6bf None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.016451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba52c97-0d2e-435e-9b66-7353d09fe6bf None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.018008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:35:49.023247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999a40-b505-4e11-9ed4-d337dd6bdf90 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.023773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999a40-b505-4e11-9ed4-d337dd6bdf90 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.024263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999a40-b505-4e11-9ed4-d337dd6bdf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.033484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 33/64] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:49.043704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-36999a40-b505-4e11-9ed4-d337dd6bdf90 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:49.045153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-36999a40-b505-4e11-9ed4-d337dd6bdf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:49.155521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 32/65] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:49.175094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c397a-4a15-43af-ad74-d633a66e4bcb None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.175094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c397a-4a15-43af-ad74-d633a66e4bcb None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.175094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c397a-4a15-43af-ad74-d633a66e4bcb None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.175094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 34/66] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:49.179607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb89ec-8c8c-43b3-a0fd-606b19060ab5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.179899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb89ec-8c8c-43b3-a0fd-606b19060ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.180179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb89ec-8c8c-43b3-a0fd-606b19060ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.205949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-19eb89ec-8c8c-43b3-a0fd-606b19060ab5 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:49.207156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-19eb89ec-8c8c-43b3-a0fd-606b19060ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:49.232451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:49.299219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 33/67] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:49.362820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1c07-0315-4147-aac3-4e0650cb46d6 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.363137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1c07-0315-4147-aac3-4e0650cb46d6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.363372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1c07-0315-4147-aac3-4e0650cb46d6 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.364858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 35/68] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:49.371168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504fa7-c675-4cde-97f5-b91efcb7e37f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.371726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504fa7-c675-4cde-97f5-b91efcb7e37f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.372191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8504fa7-c675-4cde-97f5-b91efcb7e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.390918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c8504fa7-c675-4cde-97f5-b91efcb7e37f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:49.392721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1c07-0315-4147-aac3-4e0650cb46d6 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:49.393008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c8504fa7-c675-4cde-97f5-b91efcb7e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:49.433358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:49.502463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 34/69] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:49.503628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8504fa7-c675-4cde-97f5-b91efcb7e37f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:49.577218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb1c07-0315-4147-aac3-4e0650cb46d6 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:49.619607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:49.643166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8504fa7-c675-4cde-97f5-b91efcb7e37f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:49.649410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:49.651433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.651935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.652415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.669500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:49.676045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:49.676889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:35:49.677669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:35:49.678283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:49.689545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db4c07-bc81-43a3-a1a9-a919372ee5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:49.690123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db4c07-bc81-43a3-a1a9-a919372ee5a7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.690409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db4c07-bc81-43a3-a1a9-a919372ee5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.690691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db4c07-bc81-43a3-a1a9-a919372ee5a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.701231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db4c07-bc81-43a3-a1a9-a919372ee5a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-f5db4c07-bc81-43a3-a1a9-a919372ee5a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:49.706083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:49.706928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:49.707684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:49.709038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72710-f57d-4d9b-938b-6b8e41b12292 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.709205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72710-f57d-4d9b-938b-6b8e41b12292 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.709483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd72710-f57d-4d9b-938b-6b8e41b12292 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.710870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 36/72] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:49.713711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72710-f57d-4d9b-938b-6b8e41b12292 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:49.766772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:49.787607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c26487-8297-4971-bcc9-7669fe7109be None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:49.821204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:49.821922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.822212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.822486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.824497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd72710-f57d-4d9b-938b-6b8e41b12292 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:49.833091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:49.838393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:49.839250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:35:49.840030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:49.841261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:49.862234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a17401-38a7-4e18-8786-d01816009e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:49.862846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a17401-38a7-4e18-8786-d01816009e98 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.863126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a17401-38a7-4e18-8786-d01816009e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.863397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a17401-38a7-4e18-8786-d01816009e98 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.864063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a17401-38a7-4e18-8786-d01816009e98 None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:49.864368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a17401-38a7-4e18-8786-d01816009e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:49.865797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a17401-38a7-4e18-8786-d01816009e98 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:49.870828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:49.876962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:49.876962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed014543-8e28-413a-944a-2839bf1a5672 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.876962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed014543-8e28-413a-944a-2839bf1a5672 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.876962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed014543-8e28-413a-944a-2839bf1a5672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.894147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ed014543-8e28-413a-944a-2839bf1a5672 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:49.895353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ed014543-8e28-413a-944a-2839bf1a5672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:49.940221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5250d-245f-4f3c-adb2-a345230a4cf0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:49.960984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 38/75] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:49.961932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed014543-8e28-413a-944a-2839bf1a5672 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:49.977771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:49.978385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:49.978663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:49.978935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:49.979603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:49.979909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:49.981339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:49.990137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:49.990955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:49.993706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.076799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed014543-8e28-413a-944a-2839bf1a5672 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.103253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031778c3-527a-41aa-a02f-2b3e4bfe2655 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.105840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.113856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.114497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.115131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.115411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.126835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:50.131670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:50.132682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 39/77] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:50.138665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.147465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e213a9-029a-4309-a685-887833474c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.148152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e213a9-029a-4309-a685-887833474c50 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.148441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e213a9-029a-4309-a685-887833474c50 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.148721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e213a9-029a-4309-a685-887833474c50 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.149927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e213a9-029a-4309-a685-887833474c50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:50.149927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e213a9-029a-4309-a685-887833474c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.151212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e213a9-029a-4309-a685-887833474c50 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.164794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 39/78] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:50.170210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e213a9-029a-4309-a685-887833474c50 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.235724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.248649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2850a-8df2-4db4-88ee-852d94e37325 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.275181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e213a9-029a-4309-a685-887833474c50 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.284059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.284697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.285005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.285282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.298171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.299625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.301276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 40/79] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:50.302043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.310628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.311260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.311543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.311817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] PATH_INFO: `/v3/users/5c585d4ca5124180a1443dfe66cd6371` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.313104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] RBAC: Authorizing `identity:get_user(user_id=5c585d4ca5124180a1443dfe66cd6371)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.314563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.316110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 40/80] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/users/5c585d4ca5124180a1443dfe66cd6371 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:50.320656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.354813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.415874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791d768-4d12-4a1b-87f9-3dbc22ab4248 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.422072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9e6ca-300f-42c0-bcc5-7c1fea69327d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.451843 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.452412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.452521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.452706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.453008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.453748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:50.454016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.455538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.457741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.458379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.458670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.458949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.460105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.461646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.463477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 41/81] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:50.468251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.468381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 41/82] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:50.468381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.564336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b034-21b1-492c-ab20-850a6af5c61b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.571057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117ce78-4015-4210-a565-17960c93cdfd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.581513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.597091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.597730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.598023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.598324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.599441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.600893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.602554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 42/83] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:50.603513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.606552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.608048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.608337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.608617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.670523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.680310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.681906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.705036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbd519-ba3b-4d75-89f6-c41aecdbeb17 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.739921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.740545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.740832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.741146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.779786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 42/84] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:35:50.781083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.792746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.808996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.810512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:50.878316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:50.883244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1bd80-ef1e-4cdf-9aec-fd4cf13f4c8c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:50.912138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 43/85] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:35:50.913000 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:50.917501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:50.918114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:50.918392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:50.918663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:50.987652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:50.989694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.002390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.015470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c341eb-3cd9-4beb-9c54-4cd45df04b60 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.050484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.051099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.051370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.051645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.052777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.054259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.055852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 44/86] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:51.056693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.094293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.095737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 43/87] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:35:51.096798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.166226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184dff1-e4de-4dfd-88f8-16397eaa7750 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.198783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b633b-7f04-4451-9762-d468fe82a0ad None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.203019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.203707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.203996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.204284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.204969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.206460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.209298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.237667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 45/88] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:35:51 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:51.237667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.241155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.241830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.242121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.242392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.243770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.245438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.252495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 44/89] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:51.252495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.341779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.352189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089203be-1e9b-4d65-b781-20d5ce5f1f03 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.375118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2f87-c9e3-4107-bc30-bef2539ddb9c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.393633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.394290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.394576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.394867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.395988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.397496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.399157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 46/90] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:51.400108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.416251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa362281-3781-4736-9636-d516cabb729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.416808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362281-3781-4736-9636-d516cabb729f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.417142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362281-3781-4736-9636-d516cabb729f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.417407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa362281-3781-4736-9636-d516cabb729f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.482303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.514768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa362281-3781-4736-9636-d516cabb729f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.516388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa362281-3781-4736-9636-d516cabb729f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.523085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3a7e-2f38-44e1-af62-7bf92d8354c4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.559398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.560191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.560571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.560966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.562198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.563645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.565713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 47/91] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:51.566152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.599378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.649709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:35:51.651532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa362281-3781-4736-9636-d516cabb729f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.690162 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef9888-aabf-4b31-874c-33d5ccbcaa09 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.733367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.734093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.734470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.734812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.735683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=3b4cd934abbd4b7bb59c7d168dacd9af) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:51.736071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.737105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.738673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.746328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 48/93] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/role_assignments?user.id=3b4cd934abbd4b7bb59c7d168dacd9af&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=ad683698d38f4826b4af8e1069955c8e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:51.747155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.777238 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa362281-3781-4736-9636-d516cabb729f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.843781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.844443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.844722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.845014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.845821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=5c585d4ca5124180a1443dfe66cd6371) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:51.846127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.847621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.857285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 46/94] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/role_assignments?user.id=5c585d4ca5124180a1443dfe66cd6371&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:51.857585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:51.858128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:51.867467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e34d58-9934-4de0-9ee2-67b9f8d60b48 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:51.938109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:51.938867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:51.939151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:51.939425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:51.940474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] RBAC: Adding query filter params (role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=3b4cd934abbd4b7bb59c7d168dacd9af) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:51.940727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:51.942254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:51.958979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 49/95] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/role_assignments?user.id=3b4cd934abbd4b7bb59c7d168dacd9af&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:52.056105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d85501-2cc0-441b-b205-8afac47e6fe1 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:52.100265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aece7-496c-4623-be75-d4541dccf731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:52.100992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aece7-496c-4623-be75-d4541dccf731 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:52.101279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aece7-496c-4623-be75-d4541dccf731 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:52.101608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aece7-496c-4623-be75-d4541dccf731 None admin] PATH_INFO: `/v3/projects/d6a748c7ac264e598e0d08752f884ae7` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:52.104809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aece7-496c-4623-be75-d4541dccf731 None admin] RBAC: Authorizing `identity:get_project(project_id=d6a748c7ac264e598e0d08752f884ae7)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:52.106359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aece7-496c-4623-be75-d4541dccf731 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:52.108349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 47/96] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:51 2022] GET /identity/v3/projects/d6a748c7ac264e598e0d08752f884ae7 => generated 312 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:52.114774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:52.243972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458bb18-53d9-406f-987f-b142a2ee0130 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:52.280724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf711b-9c31-4815-9a54-9bab0091413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:52.281481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf711b-9c31-4815-9a54-9bab0091413c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:52.281771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf711b-9c31-4815-9a54-9bab0091413c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:52.282048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf711b-9c31-4815-9a54-9bab0091413c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:52.282785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf711b-9c31-4815-9a54-9bab0091413c None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=d6a748c7ac264e598e0d08752f884ae7, user.id=3b4cd934abbd4b7bb59c7d168dacd9af) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:52.283096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf711b-9c31-4815-9a54-9bab0091413c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:52.284568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf711b-9c31-4815-9a54-9bab0091413c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:52.291197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 50/97] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:35:52 2022] GET /identity/v3/role_assignments?user.id=3b4cd934abbd4b7bb59c7d168dacd9af&scope.project.id=d6a748c7ac264e598e0d08752f884ae7&role.id=ad683698d38f4826b4af8e1069955c8e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:53.912777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ae2d-72d1-48cc-93af-d563fd6ae03e None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:53.913372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ae2d-72d1-48cc-93af-d563fd6ae03e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:53.913372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917ae2d-72d1-48cc-93af-d563fd6ae03e None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:53.915061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 48/98] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:53.920100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61eb34-ab4a-4d0c-a934-a0f0446da60f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:53.920505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61eb34-ab4a-4d0c-a934-a0f0446da60f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:53.920670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61eb34-ab4a-4d0c-a934-a0f0446da60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:53.945888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2e61eb34-ab4a-4d0c-a934-a0f0446da60f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:53.947275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2e61eb34-ab4a-4d0c-a934-a0f0446da60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:53.962047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:54.022812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:54.236813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8804e8b-80b4-46bf-841a-ed05f75b6dc3 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.237035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8804e8b-80b4-46bf-841a-ed05f75b6dc3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.237506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8804e8b-80b4-46bf-841a-ed05f75b6dc3 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.239051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 49/100] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:54.244701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553111e-133a-4b72-9802-408a761526dc None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.245224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553111e-133a-4b72-9802-408a761526dc None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.245663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553111e-133a-4b72-9802-408a761526dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.274079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8553111e-133a-4b72-9802-408a761526dc None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:54.275651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8553111e-133a-4b72-9802-408a761526dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:54.357539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 52/101] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:54.498766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8804e8b-80b4-46bf-841a-ed05f75b6dc3 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:54.512749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:54.606833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8804e8b-80b4-46bf-841a-ed05f75b6dc3 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:54.641064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22e975-455b-4fce-a33a-f15c589e488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:54.641705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e975-455b-4fce-a33a-f15c589e488d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.641991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e975-455b-4fce-a33a-f15c589e488d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.642268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e975-455b-4fce-a33a-f15c589e488d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.653309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22e975-455b-4fce-a33a-f15c589e488d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-3f22e975-455b-4fce-a33a-f15c589e488d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:54.658638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:54.659529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:54.660283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 50/102] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:54.666690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553111e-133a-4b72-9802-408a761526dc None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:54.758792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68641d4d-ba55-4ace-b91d-476b09b8b532 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.759103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68641d4d-ba55-4ace-b91d-476b09b8b532 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.759383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68641d4d-ba55-4ace-b91d-476b09b8b532 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.761031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 51/103] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:35:54.776342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33378ad-8c34-4a37-a510-421917181b67 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.776707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33378ad-8c34-4a37-a510-421917181b67 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.776945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33378ad-8c34-4a37-a510-421917181b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.797451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:54.806590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c33378ad-8c34-4a37-a510-421917181b67 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:54.807825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c33378ad-8c34-4a37-a510-421917181b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:54.835067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553111e-133a-4b72-9802-408a761526dc None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:54.888720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb3ef7-d7f4-4f1a-bca9-2374bfc39a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:54.889378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3ef7-d7f4-4f1a-bca9-2374bfc39a9c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.889667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3ef7-d7f4-4f1a-bca9-2374bfc39a9c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.889989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb3ef7-d7f4-4f1a-bca9-2374bfc39a9c None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.890615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3ef7-d7f4-4f1a-bca9-2374bfc39a9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:54.890921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3ef7-d7f4-4f1a-bca9-2374bfc39a9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:54.892442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb3ef7-d7f4-4f1a-bca9-2374bfc39a9c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:54.902744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 53/104] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:35:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:54.902877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be61e-8ad6-4913-8fb7-49d59c6010e1 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.903361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be61e-8ad6-4913-8fb7-49d59c6010e1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.903361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220be61e-8ad6-4913-8fb7-49d59c6010e1 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.904747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 54/105] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:54.905817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c94622-64d9-4536-a4e3-34bce7bf5e4b None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.905923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c94622-64d9-4536-a4e3-34bce7bf5e4b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.906510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c94622-64d9-4536-a4e3-34bce7bf5e4b None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.907531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 55/106] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:54.908083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c94622-64d9-4536-a4e3-34bce7bf5e4b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:54.911932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:54.918208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 52/107] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:54.919252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a633de-1d71-46e8-a974-46d640d2937a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:54.919537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a633de-1d71-46e8-a974-46d640d2937a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:54.919813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a633de-1d71-46e8-a974-46d640d2937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:54.939441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-17a633de-1d71-46e8-a974-46d640d2937a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:54.940785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-17a633de-1d71-46e8-a974-46d640d2937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:55.026439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 53/108] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:55.027940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a633de-1d71-46e8-a974-46d640d2937a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.037380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c94622-64d9-4536-a4e3-34bce7bf5e4b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.071968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875466e-6fd6-4ca2-ab5a-0f0ca94f4541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.072618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875466e-6fd6-4ca2-ab5a-0f0ca94f4541 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.072905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875466e-6fd6-4ca2-ab5a-0f0ca94f4541 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.073213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875466e-6fd6-4ca2-ab5a-0f0ca94f4541 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.074359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875466e-6fd6-4ca2-ab5a-0f0ca94f4541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:55.075823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875466e-6fd6-4ca2-ab5a-0f0ca94f4541 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:55.077469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 56/109] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:55.082018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534098-a468-4eb9-99d0-2c491069d219 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.082018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534098-a468-4eb9-99d0-2c491069d219 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.082018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39534098-a468-4eb9-99d0-2c491069d219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.099118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-39534098-a468-4eb9-99d0-2c491069d219 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:55.100715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-39534098-a468-4eb9-99d0-2c491069d219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:55.103909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:55.154766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a633de-1d71-46e8-a974-46d640d2937a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.181287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 57/110] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:55.182440 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534098-a468-4eb9-99d0-2c491069d219 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.188159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:55.194393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.195389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.195960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.196893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] PATH_INFO: `/v3/users/b3077faf11634158abb8e4208c25b0bb` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.212313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] RBAC: Authorizing `identity:get_user(user_id=b3077faf11634158abb8e4208c25b0bb)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:55.214199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:55.216393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 54/111] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:55 2022] GET /identity/v3/users/b3077faf11634158abb8e4208c25b0bb => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:55.222287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.361550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39534098-a468-4eb9-99d0-2c491069d219 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.378781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cb94c-bd7a-4a1e-afda-3559fe3c790b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.396692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.397363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.397703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.397981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.398959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:55.400249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:55.412183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:55.424084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199363a0-5a71-4bb8-82da-23da3f4360e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.425095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199363a0-5a71-4bb8-82da-23da3f4360e3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.425575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199363a0-5a71-4bb8-82da-23da3f4360e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.426038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199363a0-5a71-4bb8-82da-23da3f4360e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.436981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 58/112] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:35:55 2022] POST /identity/v3/projects => generated 302 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:55.436981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.512664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:55.537619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199363a0-5a71-4bb8-82da-23da3f4360e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:55.539304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199363a0-5a71-4bb8-82da-23da3f4360e3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:55.588678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b6dde-0dd7-4500-9e9d-35d86b2a64be None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.626403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.627026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.627309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.627586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.638541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:55.644117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:55.644965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:35:55.645730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 59/113] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:55.646361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.668275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 55/114] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:35:55.670280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c43bd-0095-4ab1-abbe-d6f49cbf084e None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.671401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c43bd-0095-4ab1-abbe-d6f49cbf084e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.671878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c43bd-0095-4ab1-abbe-d6f49cbf084e None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.673838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 56/115] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:55.677881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c43bd-0095-4ab1-abbe-d6f49cbf084e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.706369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:55.757914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0014b-fcb7-4852-b5ae-9e85e0362082 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.769309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:55.783383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c43bd-0095-4ab1-abbe-d6f49cbf084e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.795110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.795756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.796040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.796310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.806525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:55.811888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:55.813034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:35:55.813796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 60/116] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:55.814502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.825958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.826706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.826973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.827237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.840384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:55.845487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:55.846411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:35:55.847295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:55.849538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 57/117] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:55.850526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:55.924755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2388d6-a541-423a-967b-e633b31dc587 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.942229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:55.959324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e5ab2-50df-4c02-896b-47bd2fcaed84 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:55.965713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8ac16-0dce-430f-a0eb-33ec23ffbdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:55.966334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ac16-0dce-430f-a0eb-33ec23ffbdba None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.966619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ac16-0dce-430f-a0eb-33ec23ffbdba None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.966895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8ac16-0dce-430f-a0eb-33ec23ffbdba None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.967574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8ac16-0dce-430f-a0eb-33ec23ffbdba None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:55.967882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8ac16-0dce-430f-a0eb-33ec23ffbdba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:55.969297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8ac16-0dce-430f-a0eb-33ec23ffbdba None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:55.978239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 61/118] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:55.979587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7b90-56e9-414c-bdcc-182322f2605e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:55.979882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7b90-56e9-414c-bdcc-182322f2605e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:55.980159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7b90-56e9-414c-bdcc-182322f2605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:55.998808 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-552f7b90-56e9-414c-bdcc-182322f2605e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:55.999990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-552f7b90-56e9-414c-bdcc-182322f2605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:56.001729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.002579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.003636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.003921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.005092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.006616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.013865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 58/119] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:55 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.013865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.036586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:56.070411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 62/120] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:56.072038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7b90-56e9-414c-bdcc-182322f2605e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.141778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138a756-197f-4d20-b64b-9a549605e438 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.182796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.183785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.184343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.184808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.185715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:56.186333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.188039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.197340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 59/121] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.198490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.204297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7b90-56e9-414c-bdcc-182322f2605e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.206849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:56.247111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.247879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.248168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.248579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.251585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:56.251893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.253602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.263735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 63/122] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.264846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.298348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:56.308958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e58f-2751-48d1-8abd-859a52573d69 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.351374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.352558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.353446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.353627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] PATH_INFO: `/v3/users/5c585d4ca5124180a1443dfe66cd6371` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.354782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] RBAC: Authorizing `identity:get_user(user_id=5c585d4ca5124180a1443dfe66cd6371)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.356441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.358304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 60/123] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/users/5c585d4ca5124180a1443dfe66cd6371 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.364061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.390338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62261bb-ea4d-4978-bf1e-e0b57c42cee1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.428565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.429206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.429486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.429757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.430563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] RBAC: Adding query filter params (role.id=06cd35fc6bd24aaebc92468b297664ce, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=b3077faf11634158abb8e4208c25b0bb) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:56.430874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.432872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.438341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 64/124] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/role_assignments?user.id=b3077faf11634158abb8e4208c25b0bb&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=06cd35fc6bd24aaebc92468b297664ce => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.439219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.481406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:56.484467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bdc24-6048-4d6b-8409-506c4d202e76 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.532504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054612-8701-44fa-a794-f29153097378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.533674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054612-8701-44fa-a794-f29153097378 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.534040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054612-8701-44fa-a794-f29153097378 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.534381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98054612-8701-44fa-a794-f29153097378 None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.535924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98054612-8701-44fa-a794-f29153097378 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.538012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98054612-8701-44fa-a794-f29153097378 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.539783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 61/125] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.541872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054612-8701-44fa-a794-f29153097378 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.560413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e746d-5d21-478e-a83b-0c5f66547ba0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.567421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:56.604060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.604699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.605020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.605298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.607561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.610517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.610517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 65/126] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.611144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.686740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98054612-8701-44fa-a794-f29153097378 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.713322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:56.718214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c46f8-3651-4d71-a166-89579b4f7701 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.730353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.731128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.731411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.731731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.745485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:56.752371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:56.753271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:56.754186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 62/127] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:56.754996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.757229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.757229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.757229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.757229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.757851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.759846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.761680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 66/128] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.762287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.846205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:56.872688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0753b-7d3d-4a47-9308-603144db9cd4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.873938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202de148-6e76-4f47-8883-157f87d27d29 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:56.908894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.909659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.909942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.910214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.911188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:56.911376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.912186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:56.912666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:56.912763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.913248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:56.914444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 67/129] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.914919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:56.915528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.917105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:56.919596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 63/130] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:56.920747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:56.953283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:57.031922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fe9b6-010c-4191-8843-88a73b55d772 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:57.039574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bfa3c-3821-42e8-afc0-55dc659efd6d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:57.066791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:57.067412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.067698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.067977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.068648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:57.069071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:57.070585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:57.079338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:57.079702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 68/131] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:57.080507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:57.080883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.081414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.081903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/5c585d4ca5124180a1443dfe66cd6371/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.084549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe42e1edb77415999b8e4fed6094dce, user_id=5c585d4ca5124180a1443dfe66cd6371, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:57.086371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:57.109009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 64/132] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:35:56 2022] PUT /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/5c585d4ca5124180a1443dfe66cd6371/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:35:57.110421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:57.113892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:57.241777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff619e7-8c7e-4caf-a28c-eb1d0f581795 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:57.283285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:57.284321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.284801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.285300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/3b4cd934abbd4b7bb59c7d168dacd9af/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.287793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe42e1edb77415999b8e4fed6094dce, user_id=3b4cd934abbd4b7bb59c7d168dacd9af, role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:57.290201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:57.312380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 65/133] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:35:57 2022] PUT /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/3b4cd934abbd4b7bb59c7d168dacd9af/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:35:57.314307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:57.341662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:57.363571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be447d71-c72c-4f24-afc2-678a2e97f4c1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:57.401867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:57.428312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c654929-37bd-4be4-ae1c-506a4bf7bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:57.432855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654929-37bd-4be4-ae1c-506a4bf7bd88 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.432855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654929-37bd-4be4-ae1c-506a4bf7bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.432855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654929-37bd-4be4-ae1c-506a4bf7bd88 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/3b4cd934abbd4b7bb59c7d168dacd9af/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.435670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c654929-37bd-4be4-ae1c-506a4bf7bd88 None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe42e1edb77415999b8e4fed6094dce, user_id=3b4cd934abbd4b7bb59c7d168dacd9af, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:57.437197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c654929-37bd-4be4-ae1c-506a4bf7bd88 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:57.462070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 69/134] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:35:57 2022] PUT /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/3b4cd934abbd4b7bb59c7d168dacd9af/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:35:57.472615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41710b-2165-43f4-b413-009422c81dd8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:57.478394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c38e4d-fe56-4784-a916-c3f45532e7d8 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.478708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c38e4d-fe56-4784-a916-c3f45532e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.478959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c38e4d-fe56-4784-a916-c3f45532e7d8 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.480548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 70/135] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:35:57.487604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d472bb-75bb-4550-8ea2-ad9260a3dac9 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.488035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d472bb-75bb-4550-8ea2-ad9260a3dac9 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.488457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d472bb-75bb-4550-8ea2-ad9260a3dac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.525342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-67d472bb-75bb-4550-8ea2-ad9260a3dac9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:57.526746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-67d472bb-75bb-4550-8ea2-ad9260a3dac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:57.556574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:57.557289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.557939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.557939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.561817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:57.563341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:57.568975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 66/136] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:57 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:57.570561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:57.632743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 71/137] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:57.737283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e406be-42d8-4999-b409-94a1c5d158f2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:57.767883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:57.779152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:57.780035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.780550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.780983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] PATH_INFO: `/v3/projects/d6a748c7ac264e598e0d08752f884ae7` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.784033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] RBAC: Authorizing `identity:get_project(project_id=d6a748c7ac264e598e0d08752f884ae7)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:57.785711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:57.787616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 67/138] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:57 2022] GET /identity/v3/projects/d6a748c7ac264e598e0d08752f884ae7 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:57.793491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d472bb-75bb-4550-8ea2-ad9260a3dac9 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:57.885814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:57.907247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d472bb-75bb-4550-8ea2-ad9260a3dac9 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:57.949703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:57.950654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:57.951072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:57.951479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] PATH_INFO: `/v3/projects/d6a748c7ac264e598e0d08752f884ae7/users/3b4cd934abbd4b7bb59c7d168dacd9af/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:57.953580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6a748c7ac264e598e0d08752f884ae7, user_id=3b4cd934abbd4b7bb59c7d168dacd9af, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:57.955189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:57.979488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 72/139] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:35:57 2022] PUT /identity/v3/projects/d6a748c7ac264e598e0d08752f884ae7/users/3b4cd934abbd4b7bb59c7d168dacd9af/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:35:58.130688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:58.248713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c68e96-49be-4be8-a8a4-9d4d1a453b88 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:58.294992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb4efe-caf2-4679-a77b-f9ed7f7f7148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:58.295705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb4efe-caf2-4679-a77b-f9ed7f7f7148 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:58.295998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb4efe-caf2-4679-a77b-f9ed7f7f7148 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:58.296277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb4efe-caf2-4679-a77b-f9ed7f7f7148 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:58.297512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb4efe-caf2-4679-a77b-f9ed7f7f7148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:58.298992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb4efe-caf2-4679-a77b-f9ed7f7f7148 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:58.300596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 68/140] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:35:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:58.306573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:58.465350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020116f6-d40a-4f21-822b-3e21c7703f76 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:58.513713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb729a-e920-4bda-90f5-0dd5ebe2acaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:58.514335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb729a-e920-4bda-90f5-0dd5ebe2acaf None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:58.514616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb729a-e920-4bda-90f5-0dd5ebe2acaf None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:58.514893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb729a-e920-4bda-90f5-0dd5ebe2acaf None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:58.515550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb729a-e920-4bda-90f5-0dd5ebe2acaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:58.517026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb729a-e920-4bda-90f5-0dd5ebe2acaf None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:58.563275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 73/141] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:35:58 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:35:58.801541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6affd-b6a1-4386-8b4b-e58c9f76963b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:58.802191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6affd-b6a1-4386-8b4b-e58c9f76963b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:58.802690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6affd-b6a1-4386-8b4b-e58c9f76963b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:58.804515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 69/142] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:35:58.809849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe87c6-411f-4aa2-9c6d-d20a3533633f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:58.810154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe87c6-411f-4aa2-9c6d-d20a3533633f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:58.810474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe87c6-411f-4aa2-9c6d-d20a3533633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:58.820435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:58.836969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f3fe87c6-411f-4aa2-9c6d-d20a3533633f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:35:58.838394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f3fe87c6-411f-4aa2-9c6d-d20a3533633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:35:58.910827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 74/143] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:35:59.273243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6affd-b6a1-4386-8b4b-e58c9f76963b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:59.351341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:59.394647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6affd-b6a1-4386-8b4b-e58c9f76963b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:59.430807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:59.431375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:59.431658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:59.431945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:59.442707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:35:59.448360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:35:59.449201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:35:59.450021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 70/144] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:35:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:35:59.455545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe87c6-411f-4aa2-9c6d-d20a3533633f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:59.562743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe87c6-411f-4aa2-9c6d-d20a3533633f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:59.598066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:59.603122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:59.603760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:59.604257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:59.604534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:59.605239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:35:59.605544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:59.606946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:59.620357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 75/145] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:35:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:59.626120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:59.743488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92795ca-0135-4a0d-bfa9-cbe76fa63493 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:59.778530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:59.779189 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:59.779486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:59.779769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] PATH_INFO: `/v3/users/b3077faf11634158abb8e4208c25b0bb` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:59.780961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] RBAC: Authorizing `identity:get_user(user_id=b3077faf11634158abb8e4208c25b0bb)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:59.782559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:59.784514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 71/146] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:35:59 2022] GET /identity/v3/users/b3077faf11634158abb8e4208c25b0bb => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:59.784787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:35:59.790588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:59.907270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d1764-26fc-4f9f-9953-c7bfc5180af7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:35:59.944532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d945d-253f-486e-a493-278ca4825181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:35:59.945208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d945d-253f-486e-a493-278ca4825181 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:59.945491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d945d-253f-486e-a493-278ca4825181 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:59.945767 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d945d-253f-486e-a493-278ca4825181 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:59.946965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d945d-253f-486e-a493-278ca4825181 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:35:59.948499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d945d-253f-486e-a493-278ca4825181 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:35:59.955050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 76/147] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:35:59 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:35:59.956817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:35:59.995081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b25e17-fc85-482c-82a0-0914960b94f4 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:35:59.995364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b25e17-fc85-482c-82a0-0914960b94f4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:35:59.995532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b25e17-fc85-482c-82a0-0914960b94f4 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:35:59.996968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 77/148] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:00.002340 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245400-5a3a-410b-845f-18c750eb2ac2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.002612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245400-5a3a-410b-845f-18c750eb2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.002957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05245400-5a3a-410b-845f-18c750eb2ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.035402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-05245400-5a3a-410b-845f-18c750eb2ac2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:00.036615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-05245400-5a3a-410b-845f-18c750eb2ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:00.127803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4e11-0855-4f75-8239-26591d67f47f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:00.134860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:00.156670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 78/149] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 03 03:36:00.193693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b78aaf-d9cf-483e-8b9b-19657f28ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:00.194383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b78aaf-d9cf-483e-8b9b-19657f28ec6d None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.194664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b78aaf-d9cf-483e-8b9b-19657f28ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.194947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b78aaf-d9cf-483e-8b9b-19657f28ec6d None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/b3077faf11634158abb8e4208c25b0bb/roles/06cd35fc6bd24aaebc92468b297664ce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.198191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b78aaf-d9cf-483e-8b9b-19657f28ec6d None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe42e1edb77415999b8e4fed6094dce, user_id=b3077faf11634158abb8e4208c25b0bb, role_id=06cd35fc6bd24aaebc92468b297664ce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:00.199668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b78aaf-d9cf-483e-8b9b-19657f28ec6d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:00.215380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 72/150] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:35:59 2022] PUT /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce/users/b3077faf11634158abb8e4208c25b0bb/roles/06cd35fc6bd24aaebc92468b297664ce => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:00.663663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05245400-5a3a-410b-845f-18c750eb2ac2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:00.694611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5e53-eabf-47a9-8b62-1f4d42504de2 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.695154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5e53-eabf-47a9-8b62-1f4d42504de2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.695154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5e53-eabf-47a9-8b62-1f4d42504de2 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.696548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 73/151] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:00.702226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483074-f658-48af-b44d-ec08fbfd09f7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.702508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483074-f658-48af-b44d-ec08fbfd09f7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.702782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483074-f658-48af-b44d-ec08fbfd09f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.733512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2d483074-f658-48af-b44d-ec08fbfd09f7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:00.734736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2d483074-f658-48af-b44d-ec08fbfd09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:00.813536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:00.821604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05245400-5a3a-410b-845f-18c750eb2ac2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:00.846267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 74/152] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:00.848067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c5c0-1645-47bc-a0e8-911d322f1f98 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.850210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c5c0-1645-47bc-a0e8-911d322f1f98 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.851547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4c5c0-1645-47bc-a0e8-911d322f1f98 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.853917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 75/153] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:00.855323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf64ef-9c17-4792-ac2b-aa4caad4429d None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.857062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf64ef-9c17-4792-ac2b-aa4caad4429d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.858369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf64ef-9c17-4792-ac2b-aa4caad4429d None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.866248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 76/154] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:00.867620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d9f6-0824-4f2f-8004-a22a3b4c7eb4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.868575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d9f6-0824-4f2f-8004-a22a3b4c7eb4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.870122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d9f6-0824-4f2f-8004-a22a3b4c7eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.913903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90edabe-8359-40fc-9ec0-9ca814c2ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:00.914952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90edabe-8359-40fc-9ec0-9ca814c2ca75 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.915427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90edabe-8359-40fc-9ec0-9ca814c2ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.915880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90edabe-8359-40fc-9ec0-9ca814c2ca75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:00.917490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-9aa8d9f6-0824-4f2f-8004-a22a3b4c7eb4 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:00.920344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9aa8d9f6-0824-4f2f-8004-a22a3b4c7eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:00.940068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90edabe-8359-40fc-9ec0-9ca814c2ca75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-b90edabe-8359-40fc-9ec0-9ca814c2ca75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:00.945292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:00.946234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:00.947012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:00.955848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 79/155] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:00.958677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708a44-5df4-442d-87b5-b41f579e9776 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:00.959880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708a44-5df4-442d-87b5-b41f579e9776 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:00.960521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708a44-5df4-442d-87b5-b41f579e9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:01.001983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-62708a44-5df4-442d-87b5-b41f579e9776 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:01.004832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-62708a44-5df4-442d-87b5-b41f579e9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:01.092643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 77/156] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:01.095209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d9f6-0824-4f2f-8004-a22a3b4c7eb4 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:01.132147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:01.171973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 80/157] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:01.238695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8d9f6-0824-4f2f-8004-a22a3b4c7eb4 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:01.254208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:01.284588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:01.285237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:01.285511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:01.285779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:01.286463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:01.286762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:01.288162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:01.296998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 78/158] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:01.302657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62708a44-5df4-442d-87b5-b41f579e9776 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:01.441531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62708a44-5df4-442d-87b5-b41f579e9776 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:01.485832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:01.486778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:01.487057 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:01.487328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] PATH_INFO: `/v3/users/5c585d4ca5124180a1443dfe66cd6371` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:01.493614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] RBAC: Authorizing `identity:get_user(user_id=5c585d4ca5124180a1443dfe66cd6371)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:01.495083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:01.496932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 81/159] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:01 2022] GET /identity/v3/users/5c585d4ca5124180a1443dfe66cd6371 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:01.502379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:01.639183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b1c56-edc6-4312-bc84-e534420a65f6 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:01.683183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:01.683798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:01.684077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:01.684343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:01.738798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:01.769304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:01.770963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:01.872687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:01.901696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 79/160] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:01.907252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:01.949929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:01.998024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:02.026915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82b79d-27a5-4281-981a-74945c883fd1 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.041009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fe30c-17ee-4d43-9e97-f00acac04d2c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.068053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.068713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.069019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.069288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.071600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:02.074764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:02.076471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 80/161] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:01 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:02.077371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:02.117364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.118073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.118357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.118635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.135401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:02.150396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:02.151345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:02.152092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 82/162] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:02.152728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:02.219193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d13edb-46c6-4cca-9025-774a1266a2a5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.279745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.280307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.280585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.280853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.296061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ba321-c2c8-4b58-a8e6-6347d52e9954 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.304126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:02.321416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:02.322385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:02.323121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 81/163] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:02.323745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:02.330865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:02.332010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:02.390186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.390850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.391133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.391409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.416581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:02.422201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:02.423312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:02.424070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 83/164] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:02.428802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:02.537174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b49302-ac36-4290-af1f-009134854d18 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.546085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947fed0-61a6-4a23-94e4-fd33b4ad9925 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.585143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.585875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.586163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.586438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.587318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] RBAC: Adding query filter params (name=member) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:02.587525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:02.589082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:02.601784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 84/165] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:02.602779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:02.653894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:02.662159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.662786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.663066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.663343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.664155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=5c585d4ca5124180a1443dfe66cd6371) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:02.664466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:02.666153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:02.691024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 82/166] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/role_assignments?user.id=5c585d4ca5124180a1443dfe66cd6371&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:02.691687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:02.786272 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd2bb-da7c-4ef7-afc0-b1e6162f4074 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.830148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:02.864718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.865377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.865708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.865987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.866668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:02.866972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:02.868447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:02.880059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6738d35-bfff-4c77-9aaf-d2d8faf6025e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:02.884806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 85/167] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:02.885934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:02.958409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:02.959049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:02.959331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:02.959601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:02.960290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:02.960591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:02.963281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:02.980892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 83/168] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:02.981946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:03.065812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:03.074999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7adb5-fcab-4bdc-8f86-62b1fab295db None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:03.102633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c9f93-ed0b-4bed-b101-812b9946102b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:03.123947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c221c9c-0167-463e-b13a-0f46319c7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:03.125002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c221c9c-0167-463e-b13a-0f46319c7369 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.125296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c221c9c-0167-463e-b13a-0f46319c7369 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.125578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c221c9c-0167-463e-b13a-0f46319c7369 None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.126789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c221c9c-0167-463e-b13a-0f46319c7369 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:03.128264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c221c9c-0167-463e-b13a-0f46319c7369 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:03.130201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 86/169] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:03.132636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16296f3a-9a57-4537-9523-d50efdca2fc0 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.132941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16296f3a-9a57-4537-9523-d50efdca2fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.136563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16296f3a-9a57-4537-9523-d50efdca2fc0 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.138805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 87/170] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:03.140373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16296f3a-9a57-4537-9523-d50efdca2fc0 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:03.148702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:03.155222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db197c4-594c-4120-ade9-cfdea126be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:03.155870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db197c4-594c-4120-ade9-cfdea126be1c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.156152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db197c4-594c-4120-ade9-cfdea126be1c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.156432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db197c4-594c-4120-ade9-cfdea126be1c None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.159986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db197c4-594c-4120-ade9-cfdea126be1c None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:03.159986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db197c4-594c-4120-ade9-cfdea126be1c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:03.160690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 84/171] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:02 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:03.164028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a780-2ed5-4380-8f19-e5faaa07ff70 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.164316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a780-2ed5-4380-8f19-e5faaa07ff70 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.164594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0a780-2ed5-4380-8f19-e5faaa07ff70 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.168148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 85/172] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:03.168148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0a780-2ed5-4380-8f19-e5faaa07ff70 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:03.287511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16296f3a-9a57-4537-9523-d50efdca2fc0 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:03.308050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0a780-2ed5-4380-8f19-e5faaa07ff70 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:03.335534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77433d00-e006-4cd3-a407-4c8dfed07ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:03.336799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433d00-e006-4cd3-a407-4c8dfed07ad6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.337672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433d00-e006-4cd3-a407-4c8dfed07ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.338439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433d00-e006-4cd3-a407-4c8dfed07ad6 None admin] PATH_INFO: `/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.340311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77433d00-e006-4cd3-a407-4c8dfed07ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4cd934abbd4b7bb59c7d168dacd9af)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:03.342718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77433d00-e006-4cd3-a407-4c8dfed07ad6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:03.345678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 88/173] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:03 2022] GET /identity/v3/users/3b4cd934abbd4b7bb59c7d168dacd9af => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:03.352712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca06de-39b9-4da4-9fe3-dd55a01dff3a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.352712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca06de-39b9-4da4-9fe3-dd55a01dff3a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.352712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca06de-39b9-4da4-9fe3-dd55a01dff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.357836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90cd45-f07f-4879-b81f-f500fd86b840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:03.359749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90cd45-f07f-4879-b81f-f500fd86b840 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.360307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90cd45-f07f-4879-b81f-f500fd86b840 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.360771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90cd45-f07f-4879-b81f-f500fd86b840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.369732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-70ca06de-39b9-4da4-9fe3-dd55a01dff3a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:03.370934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-70ca06de-39b9-4da4-9fe3-dd55a01dff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:03.396465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:03.448967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 89/174] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:03.448967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca06de-39b9-4da4-9fe3-dd55a01dff3a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:03.469191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:03.474378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90cd45-f07f-4879-b81f-f500fd86b840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:03.475871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90cd45-f07f-4879-b81f-f500fd86b840 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:03.602222 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca06de-39b9-4da4-9fe3-dd55a01dff3a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:03.640079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 86/175] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:03.641657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d628c6-b9a6-4a59-8a62-526658e09a67 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.642092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d628c6-b9a6-4a59-8a62-526658e09a67 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.642510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d628c6-b9a6-4a59-8a62-526658e09a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.651733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48443-0a7a-4286-b7e4-ce212b67b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:03.652357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48443-0a7a-4286-b7e4-ce212b67b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.652639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48443-0a7a-4286-b7e4-ce212b67b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.652932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48443-0a7a-4286-b7e4-ce212b67b3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.662567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-99d628c6-b9a6-4a59-8a62-526658e09a67 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:03.664034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-99d628c6-b9a6-4a59-8a62-526658e09a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:03.681594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:03.723094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48443-0a7a-4286-b7e4-ce212b67b3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:03.724556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48443-0a7a-4286-b7e4-ce212b67b3a4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:03.736055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 87/176] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:03.746511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d628c6-b9a6-4a59-8a62-526658e09a67 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:03.784228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:03.829439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 90/177] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:03.830784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310d43-7dd4-4d14-8a3b-41543c0e87b4 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.831075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310d43-7dd4-4d14-8a3b-41543c0e87b4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.831351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9310d43-7dd4-4d14-8a3b-41543c0e87b4 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.832608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 91/178] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:03.833402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9310d43-7dd4-4d14-8a3b-41543c0e87b4 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:03.860862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d628c6-b9a6-4a59-8a62-526658e09a67 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:03.895856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:03.896388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.896667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.896945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.897847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:03.946938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9310d43-7dd4-4d14-8a3b-41543c0e87b4 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:03.969477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:03.971355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:03.981786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dea17-d8f3-4a5b-af68-4dda1d75966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:03.982420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dea17-d8f3-4a5b-af68-4dda1d75966d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.982704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dea17-d8f3-4a5b-af68-4dda1d75966d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.982983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dea17-d8f3-4a5b-af68-4dda1d75966d None admin] PATH_INFO: `/v3/projects/d6a748c7ac264e598e0d08752f884ae7` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.984131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dea17-d8f3-4a5b-af68-4dda1d75966d None admin] RBAC: Authorizing `identity:get_project(project_id=d6a748c7ac264e598e0d08752f884ae7)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:03.985600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dea17-d8f3-4a5b-af68-4dda1d75966d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:03.987562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 92/179] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:03 2022] GET /identity/v3/projects/d6a748c7ac264e598e0d08752f884ae7 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:03.988753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d7579-2bfb-4dbc-bc48-eda7701281e9 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:03.989063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d7579-2bfb-4dbc-bc48-eda7701281e9 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:03.989339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d7579-2bfb-4dbc-bc48-eda7701281e9 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:03.990538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 93/180] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:03.993087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d7579-2bfb-4dbc-bc48-eda7701281e9 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.007548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.080047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 88/181] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:04.080879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.100794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d7579-2bfb-4dbc-bc48-eda7701281e9 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.128888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.137320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f9aa4-25a0-4e57-b808-9bf2e24ac78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.137951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f9aa4-25a0-4e57-b808-9bf2e24ac78d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.138248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f9aa4-25a0-4e57-b808-9bf2e24ac78d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.138509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f9aa4-25a0-4e57-b808-9bf2e24ac78d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.149310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f9aa4-25a0-4e57-b808-9bf2e24ac78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5b8f9aa4-25a0-4e57-b808-9bf2e24ac78d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:04.154092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:04.155001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:04.155764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 94/182] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:04.157750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2131-5b77-419b-9094-3b614e9e746a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.158037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2131-5b77-419b-9094-3b614e9e746a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.158310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2131-5b77-419b-9094-3b614e9e746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.177479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9f7c2131-5b77-419b-9094-3b614e9e746a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:04.178686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9f7c2131-5b77-419b-9094-3b614e9e746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:04.185997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072ce05-35f7-49f6-8e9c-ce0b3f70392a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.212582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.220371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.221045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.221330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.221604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.222726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:04.224181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:04.226201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 89/183] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:04.227047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.260616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 95/184] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:04.260616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994945-02fe-4f3b-a97d-ee4c1dc0e960 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.260616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994945-02fe-4f3b-a97d-ee4c1dc0e960 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.260616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994945-02fe-4f3b-a97d-ee4c1dc0e960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.276005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-83994945-02fe-4f3b-a97d-ee4c1dc0e960 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:04.277215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-83994945-02fe-4f3b-a97d-ee4c1dc0e960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:04.332006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065284a0-3ed6-4496-923e-8c0ff16f3328 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.348450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 96/185] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:04.357833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994945-02fe-4f3b-a97d-ee4c1dc0e960 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.371813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.372751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.373246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.373711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.374729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=d6a748c7ac264e598e0d08752f884ae7, user.id=3b4cd934abbd4b7bb59c7d168dacd9af) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:04.375261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:04.377068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:04.383850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 90/186] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/role_assignments?user.id=3b4cd934abbd4b7bb59c7d168dacd9af&scope.project.id=d6a748c7ac264e598e0d08752f884ae7&role.id=ad683698d38f4826b4af8e1069955c8e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:04.390442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.420140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.481188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994945-02fe-4f3b-a97d-ee4c1dc0e960 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.514669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.544401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.544657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.544997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.545344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.557884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:04.563393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:04.564428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:04.565223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 97/187] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:04.565875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.581603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d55118-26cd-400e-b067-a662aaf334ba None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.624445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.625385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.625671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.626010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.627147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:04.628679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:04.630377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 91/188] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:04.631144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.687534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cb54d-8b82-4856-a215-a60aeb947570 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.697306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.721709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.722313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.722591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.722868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.723524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:04.723823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:04.725248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:04.733350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 98/189] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:04.733935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.742934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bf118-ec40-48a7-94b4-e6342ab023bb None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.771136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.779139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.779750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.780032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.780308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.781087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] RBAC: Adding query filter params (role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=3b4cd934abbd4b7bb59c7d168dacd9af) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:04.781399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:04.782849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:04.788607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 92/190] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/role_assignments?user.id=3b4cd934abbd4b7bb59c7d168dacd9af&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:04.789439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.854927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ce160-9624-4a2d-96b1-dbf014c16a71 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.896374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.897070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.897356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.897696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.912736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb5036-0694-4412-8e45-25b40ea282a8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:04.913525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:04.921258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:04.922203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:04.923484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 99/191] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:04.924147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:04.953656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:04.954659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:04.954940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:04.955211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:04.955884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:04.956415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:04.958307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:04.963356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:04.967440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 93/192] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:04.968278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.037861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.042014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e224-2413-476a-bc68-43aefa42c4b1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.079963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.080602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.080876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.081184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.082307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.083807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.084106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c541c-8f86-4c27-a559-8c4a79ccc0f3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.085456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 100/193] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:05.090265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.125207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.125817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.126094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.126356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.127148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=3b4cd934abbd4b7bb59c7d168dacd9af) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:05.127456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.128937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.135205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 94/194] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:04 2022] GET /identity/v3/role_assignments?user.id=3b4cd934abbd4b7bb59c7d168dacd9af&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=ad683698d38f4826b4af8e1069955c8e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:05.136023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.211813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.216062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444b6b5-c887-491b-b065-30927d2bfdee None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.257898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.258603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.259333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.259333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] PATH_INFO: `/v3/users/5aad84384cc24f179f7f941ba4d41df9` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.265023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b55b1a-a43f-480b-a4a2-b0576683fc1d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.278928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] RBAC: Authorizing `identity:get_user(user_id=5aad84384cc24f179f7f941ba4d41df9)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.280561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.283014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 101/195] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:05 2022] GET /identity/v3/users/5aad84384cc24f179f7f941ba4d41df9 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:05.283795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.286826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.308633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.309276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.309555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.309830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.310499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:05.310816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.312178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.326562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 95/196] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:05.326562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.396047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4bdd-2de0-48ce-ba66-3f65ca002387 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.431198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.431808 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.432083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.432346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] PATH_INFO: `/v3/users/5aad84384cc24f179f7f941ba4d41df9` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.433477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] RBAC: Authorizing `identity:get_user(user_id=5aad84384cc24f179f7f941ba4d41df9)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.434944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.435292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d572d-0bf2-44f6-96dd-32be5687b0f4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.436550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 102/197] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:05 2022] GET /identity/v3/users/5aad84384cc24f179f7f941ba4d41df9 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:05.437333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.465768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.475274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.475890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.476194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.476448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.477143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.478910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.506778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 96/198] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:05 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:05.507595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.553352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f218bc1-27ed-4d32-9f9f-2a5e640249d5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.560110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.597887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.598545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.598836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.599105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.639678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0b6ec-88ef-4cd9-8bb0-eea2c3097e19 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.675162 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.676635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.687133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.688135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.688418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.689628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] PATH_INFO: `/v3/users/b3077faf11634158abb8e4208c25b0bb` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.692173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] RBAC: Authorizing `identity:get_user(user_id=b3077faf11634158abb8e4208c25b0bb)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.696618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.696618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 97/199] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:05 2022] GET /identity/v3/users/b3077faf11634158abb8e4208c25b0bb => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:05.696618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.713280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.818780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 103/200] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:05.820130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:05.830527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279020ed-e30b-4f57-8db6-fbf6058248a4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.832673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.873048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.873674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.873956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.874230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:05.935417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea85f5-cc45-4a8b-a3be-f56b0dc57132 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:05.945047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:05.946598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:05.963168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:05.973355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:05.974078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:05.974367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:05.974729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:06.047357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:06.048855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:06.049806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 98/201] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:06.050495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:06.060607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:06.157511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d36f26-580a-4777-98d1-e6f35905bafc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:06.160890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 104/202] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:06.161799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:06.197807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:06.199730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:06.200379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:06.200658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:06.201068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:06.205052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:06.206805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:06.209759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 99/203] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:06 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:06.210765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:06.287033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1c695-8016-45e2-bea9-1dfc9d445315 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:06.302613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:06.332076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:06.333137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:06.333619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:06.334170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:06.335578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:06.337367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:06.339380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 105/204] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:06 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:06.340351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:06.346194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb219ed-f99b-4b53-aa97-51d626f8ae14 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:06.382598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:06.383311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:06.383794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:06.384175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:06.385768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:06.386935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:06.394072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 100/205] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:06 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:06.394998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:06.442447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:06.453648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb17f1-4d0e-490b-9380-749809f2683c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:06.490566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:06.491570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:06.492115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:06.492574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:06.493787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=5aad84384cc24f179f7f941ba4d41df9) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:06.494402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:06.496139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:06.501413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb99cd-c941-45d7-aaa2-7ae4001d78cb None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:06.502517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 106/206] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:06 2022] GET /identity/v3/role_assignments?user.id=5aad84384cc24f179f7f941ba4d41df9&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:06.503780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:06.547654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f6cc5-68a1-4a68-aa77-d75cf5535a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:06.548345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f6cc5-68a1-4a68-aa77-d75cf5535a1d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:06.548631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f6cc5-68a1-4a68-aa77-d75cf5535a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:06.548907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f6cc5-68a1-4a68-aa77-d75cf5535a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:06.549769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f6cc5-68a1-4a68-aa77-d75cf5535a1d None admin] RBAC: Adding query filter params (role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=5aad84384cc24f179f7f941ba4d41df9) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:06.550085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f6cc5-68a1-4a68-aa77-d75cf5535a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:06.551679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f6cc5-68a1-4a68-aa77-d75cf5535a1d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:06.558340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 101/207] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:06 2022] GET /identity/v3/role_assignments?user.id=5aad84384cc24f179f7f941ba4d41df9&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:06.626465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa689edf-2ef4-45a1-92e6-2dbeb08ccc6b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:06.666920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c2c37-3eb9-4337-99c1-be45e12d8300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:06.667905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c2c37-3eb9-4337-99c1-be45e12d8300 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:06.668425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c2c37-3eb9-4337-99c1-be45e12d8300 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:06.668885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c2c37-3eb9-4337-99c1-be45e12d8300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:06.669840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c2c37-3eb9-4337-99c1-be45e12d8300 None admin] RBAC: Adding query filter params (role.id=06cd35fc6bd24aaebc92468b297664ce, scope.project.id=1fe42e1edb77415999b8e4fed6094dce, user.id=b3077faf11634158abb8e4208c25b0bb) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:06.670355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c2c37-3eb9-4337-99c1-be45e12d8300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:06.672029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c2c37-3eb9-4337-99c1-be45e12d8300 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:06.679183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 107/208] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:06 2022] GET /identity/v3/role_assignments?user.id=b3077faf11634158abb8e4208c25b0bb&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=06cd35fc6bd24aaebc92468b297664ce => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:07.703713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e2135-c05b-48e1-9706-3858545b1c5f None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:07.704227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e2135-c05b-48e1-9706-3858545b1c5f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:07.704301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e2135-c05b-48e1-9706-3858545b1c5f None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:07.705932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 102/209] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:07.711290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c582246-87d2-430f-9c59-f7af3b9b034c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:07.712154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c582246-87d2-430f-9c59-f7af3b9b034c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:07.712638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c582246-87d2-430f-9c59-f7af3b9b034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:07.730422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a758a1-a41f-49be-aaaa-effc28e61a92 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:07.730729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a758a1-a41f-49be-aaaa-effc28e61a92 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:07.730979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a758a1-a41f-49be-aaaa-effc28e61a92 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:07.732487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 103/210] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:07.733160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8c582246-87d2-430f-9c59-f7af3b9b034c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:07.734667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8c582246-87d2-430f-9c59-f7af3b9b034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:07.738090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0303d97-6ae9-449a-ac28-eb2e809ed808 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:07.738380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0303d97-6ae9-449a-ac28-eb2e809ed808 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:07.738659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0303d97-6ae9-449a-ac28-eb2e809ed808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:07.748620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:07.753952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:07.765189 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d0303d97-6ae9-449a-ac28-eb2e809ed808 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:07.767152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d0303d97-6ae9-449a-ac28-eb2e809ed808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:07.814617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 108/211] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:07.846936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 104/212] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:08.086120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c582246-87d2-430f-9c59-f7af3b9b034c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:08.126408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0303d97-6ae9-449a-ac28-eb2e809ed808 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:08.207234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c582246-87d2-430f-9c59-f7af3b9b034c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:08.243304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:08.244103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.244482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.244851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.246114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:08.247677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:08.249434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 109/213] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:08.254866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:08.265158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0303d97-6ae9-449a-ac28-eb2e809ed808 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:08.275420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:08.314888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:08.316074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.316511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.317184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.320077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:08.333303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:08.340137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:08.341214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:08.342223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:08.344683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 105/214] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:08.352371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:08.376312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c5ddf-75e0-4af7-9c8d-847a6fee4b40 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:08.421285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:08.421903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.422187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.422714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.423376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:08.424823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:08.454501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 110/215] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:08 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:36:08.498940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71e0f-9ea4-43c7-94fe-a2c624aeec1a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:08.550661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec9d5c-7cfe-4135-a933-0f45a18ede58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:08.551745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec9d5c-7cfe-4135-a933-0f45a18ede58 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.552219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec9d5c-7cfe-4135-a933-0f45a18ede58 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.552682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec9d5c-7cfe-4135-a933-0f45a18ede58 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.553594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec9d5c-7cfe-4135-a933-0f45a18ede58 None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:08.554116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec9d5c-7cfe-4135-a933-0f45a18ede58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:08.555907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec9d5c-7cfe-4135-a933-0f45a18ede58 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:08.566567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 106/216] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:08.576958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:08.605624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cc62-324a-474e-95ec-d8da117e32e2 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.605807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cc62-324a-474e-95ec-d8da117e32e2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.606052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cc62-324a-474e-95ec-d8da117e32e2 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.607655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 107/217] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:08.613094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681ef4-e3d9-45d1-b1f5-c0a7c5462ac2 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.613377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681ef4-e3d9-45d1-b1f5-c0a7c5462ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.613648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d681ef4-e3d9-45d1-b1f5-c0a7c5462ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.632604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8d681ef4-e3d9-45d1-b1f5-c0a7c5462ac2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:08.633908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8d681ef4-e3d9-45d1-b1f5-c0a7c5462ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:08.670406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:08.704271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:08.709135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35290911-9483-4c55-a426-a20e086f2dc1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:08.728575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 108/218] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:08.733042 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ca40d-cee0-4374-8eb8-90e317e20231 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.734051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ca40d-cee0-4374-8eb8-90e317e20231 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.734560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ca40d-cee0-4374-8eb8-90e317e20231 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.736124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 109/219] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:08.742198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205229a7-b556-466d-909b-4979bfe4ef2d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.742483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205229a7-b556-466d-909b-4979bfe4ef2d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.742945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205229a7-b556-466d-909b-4979bfe4ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.751199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:08.751843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.752124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.752395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] PATH_INFO: `/v3/users/e22f738d0f1948e9a491055af16a5c34` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:08.765456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-205229a7-b556-466d-909b-4979bfe4ef2d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:08.766866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-205229a7-b556-466d-909b-4979bfe4ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:08.767263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=e22f738d0f1948e9a491055af16a5c34)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:08.768801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:08.770785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 111/220] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:08 2022] GET /identity/v3/users/e22f738d0f1948e9a491055af16a5c34 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:08.776372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:08.839025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 110/221] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:08.888424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549182-afcc-408a-b914-b77f004b9ad3 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:08.919016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:08.925150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:08.925833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:08.926118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:08.926396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.000118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:09.001634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:09.028860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205229a7-b556-466d-909b-4979bfe4ef2d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.137994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 112/222] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:09.139035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.194041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205229a7-b556-466d-909b-4979bfe4ef2d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.201306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:09.212480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:09.233596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.234034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.234327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.234602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.246529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:09.251470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:09.252319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:09.253522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 111/223] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:09.254363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.280845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45d161-1515-4300-8354-1f1b756beb91 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.327813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.329762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.330266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.330734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.344834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:09.351525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:09.352529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:09.353484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:09.357065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 113/224] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:09.357065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.369671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb364968-fb37-46f1-a64b-d42588aba7a4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.413826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.415286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.415717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.416128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.417943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:09.420288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:09.422442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 112/225] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:09.423934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.476553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:09.481646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:09.488666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960a58d-0de0-450e-9bcb-db791f4d0a1b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.524679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.525591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.526012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.526425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.527257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:09.527696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:09.529315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:09.538549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 114/226] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:09.539556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.540185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b342c7-3db9-459d-aaea-a86f33b1537f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.576773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.578281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.578281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.578281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.578998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:09.579399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:09.580891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:09.595634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 113/227] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:09.596650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.648337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81687ebe-ae66-4f3d-be3b-ddde94e0c2b3 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.684020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.684843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.685293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.685727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.686638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=e22f738d0f1948e9a491055af16a5c34) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:09.687158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:09.688811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:09.695039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 115/228] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/role_assignments?user.id=e22f738d0f1948e9a491055af16a5c34&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=ad683698d38f4826b4af8e1069955c8e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:09.696101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.701840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc3a4-ec8d-480f-a8ba-e9d28d887d03 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.718194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:09.718386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:09.786785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.787450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.787730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.788003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] PATH_INFO: `/v3/users/5aad84384cc24f179f7f941ba4d41df9` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.789339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] RBAC: Authorizing `identity:get_user(user_id=5aad84384cc24f179f7f941ba4d41df9)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:09.792107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:09.793924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 114/229] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/users/5aad84384cc24f179f7f941ba4d41df9 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:09.799592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.873758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5fa48-e6c4-4c98-886e-a388445527b5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:09.912618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:09.913700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:09.914180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:09.914766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] PATH_INFO: `/v3/users/5aad84384cc24f179f7f941ba4d41df9` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:09.916183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] RBAC: Authorizing `identity:get_user(user_id=5aad84384cc24f179f7f941ba4d41df9)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:09.917872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:09.919701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 116/230] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/users/5aad84384cc24f179f7f941ba4d41df9 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:09.926121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:09.963173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4777f58-fa63-41bf-8b06-2e084e49dd0b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:10.007650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:10.009150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:10.009817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:10.010290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:10.011760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:10.013734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:10.016113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 115/231] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:10.021588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:10.097261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:10.110631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:10.114769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56db0-aaee-4f55-a597-6a05cc2339d1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:10.149747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:10.150401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:10.150689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:10.150968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:10.152190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:10.153762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:10.155430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 117/232] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:09 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:10.166748 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:10.251117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c902ca-27f3-4d19-ac22-771d69692102 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:10.282749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e10d36-fca6-4a3a-b413-38f4664c48cb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:10.319902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34203064-b91e-446c-aa0b-f8872253dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:10.320935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203064-b91e-446c-aa0b-f8872253dde2 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:10.321077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759aedd-2dfc-492a-aaa7-5304141daefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:10.321499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203064-b91e-446c-aa0b-f8872253dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:10.321912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34203064-b91e-446c-aa0b-f8872253dde2 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/5aad84384cc24f179f7f941ba4d41df9/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:10.322094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759aedd-2dfc-492a-aaa7-5304141daefc None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:10.322471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759aedd-2dfc-492a-aaa7-5304141daefc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:10.322842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759aedd-2dfc-492a-aaa7-5304141daefc None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/5aad84384cc24f179f7f941ba4d41df9/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:10.335229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34203064-b91e-446c-aa0b-f8872253dde2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5043e6fefe94a71a4b23176e17ce96b, user_id=5aad84384cc24f179f7f941ba4d41df9, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:10.336839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34203064-b91e-446c-aa0b-f8872253dde2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:10.338338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759aedd-2dfc-492a-aaa7-5304141daefc None admin] RBAC: Authorizing `identity:create_grant(project_id=a5043e6fefe94a71a4b23176e17ce96b, user_id=5aad84384cc24f179f7f941ba4d41df9, role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:10.339838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759aedd-2dfc-492a-aaa7-5304141daefc None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:10.370175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 118/233] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:10 2022] PUT /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/5aad84384cc24f179f7f941ba4d41df9/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:36:10.374528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 116/234] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:10 2022] PUT /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/5aad84384cc24f179f7f941ba4d41df9/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:10.826132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b96b1-2791-41ff-bdbf-9982fbe6b2aa None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:10.826511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b96b1-2791-41ff-bdbf-9982fbe6b2aa None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:10.826681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b96b1-2791-41ff-bdbf-9982fbe6b2aa None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:10.828366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 119/235] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:10.833565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9256bb-0b48-4e37-aec3-dd23499358b3 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:10.834015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9256bb-0b48-4e37-aec3-dd23499358b3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:10.834087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9256bb-0b48-4e37-aec3-dd23499358b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:10.853041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ec9256bb-0b48-4e37-aec3-dd23499358b3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:10.854245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ec9256bb-0b48-4e37-aec3-dd23499358b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:10.943948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 117/236] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:11.079156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97d9b6-2b0f-4747-8b03-707cf5557607 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:11.079664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97d9b6-2b0f-4747-8b03-707cf5557607 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:11.079664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97d9b6-2b0f-4747-8b03-707cf5557607 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:11.081314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 120/237] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:11.086958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac0d3-7e8b-4953-a244-8b35253c01b6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:11.087308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac0d3-7e8b-4953-a244-8b35253c01b6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:11.087575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac0d3-7e8b-4953-a244-8b35253c01b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:11.112541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8cbac0d3-7e8b-4953-a244-8b35253c01b6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:11.113753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8cbac0d3-7e8b-4953-a244-8b35253c01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:11.141393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:11.186758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 118/238] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:11.339307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97d9b6-2b0f-4747-8b03-707cf5557607 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:11.357481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:11.458354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97d9b6-2b0f-4747-8b03-707cf5557607 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:11.488101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac0d3-7e8b-4953-a244-8b35253c01b6 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:11.512142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:11.512804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:11.514256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:11.514542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:11.536623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:11.542168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:11.543019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:11.543781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 121/239] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:11.553213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:11.645937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:11.686608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac0d3-7e8b-4953-a244-8b35253c01b6 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:11.692159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca39da4-6583-48b3-b9cc-99cd0b9c8fd5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:11.748729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:11.749393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:11.749671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:11.749946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:11.751381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:11.752827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:11.754586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 119/240] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:11.757287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:11.758066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:11.758575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:11.758977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:11.759830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:11.760761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:11.761221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:11.762719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:11.778596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 122/241] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:11.796679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:11.817888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:11.942967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92825c-59a7-4d64-9f2f-54cc4bee67ba None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:11.978967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb9c2-105b-493b-9e52-10602cf4eb99 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:11.999509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3a18-8004-474b-b31c-67a07446be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:12.000464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3a18-8004-474b-b31c-67a07446be31 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.001027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3a18-8004-474b-b31c-67a07446be31 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.001493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3a18-8004-474b-b31c-67a07446be31 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.002818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3a18-8004-474b-b31c-67a07446be31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:12.005015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3a18-8004-474b-b31c-67a07446be31 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:12.015818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:12.016812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.017202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.017539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] PATH_INFO: `/v3/users/08dcb227eb6c409a857a151995cc5524` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.025235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:12.030753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 120/242] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:11 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:12.032209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3a88a-b343-459a-bfcc-7df302249833 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.032706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3a88a-b343-459a-bfcc-7df302249833 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.033187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3a88a-b343-459a-bfcc-7df302249833 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.034618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 121/243] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:12.051018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43e60-16fe-41ec-9030-0c1ac03b0075 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.051707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43e60-16fe-41ec-9030-0c1ac03b0075 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.052220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43e60-16fe-41ec-9030-0c1ac03b0075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.061100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=08dcb227eb6c409a857a151995cc5524)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:12.062921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:12.066320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 123/244] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:11 2022] GET /identity/v3/users/08dcb227eb6c409a857a151995cc5524 => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:12.074094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:12.094709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d6d43e60-16fe-41ec-9030-0c1ac03b0075 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:12.096593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d6d43e60-16fe-41ec-9030-0c1ac03b0075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:12.203695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 122/245] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:12.246501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4634e7c-fa49-4b68-b145-c2a8327fd4f2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:12.284461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:12.285381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.285804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.286217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.355121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:12.364641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:12.366241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:12.491275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 124/246] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:12.496751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43e60-16fe-41ec-9030-0c1ac03b0075 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:12.521023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:12.523220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:12.649310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43e60-16fe-41ec-9030-0c1ac03b0075 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:12.663381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:12.673452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5033e9-6496-4102-b4f8-e76bacb8a318 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:12.698204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67504e54-0fab-48f1-b63c-5741b3273def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:12.699128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504e54-0fab-48f1-b63c-5741b3273def None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.699378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504e54-0fab-48f1-b63c-5741b3273def None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.699636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504e54-0fab-48f1-b63c-5741b3273def None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.700754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67504e54-0fab-48f1-b63c-5741b3273def None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:12.702250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67504e54-0fab-48f1-b63c-5741b3273def None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:12.704080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 123/247] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:12 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:12.705009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8775-e0e9-40af-9e10-4a0136b44b99 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.705288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8775-e0e9-40af-9e10-4a0136b44b99 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.705558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8775-e0e9-40af-9e10-4a0136b44b99 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.706737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 124/248] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:12.711722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf8775-e0e9-40af-9e10-4a0136b44b99 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:12.714913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82cb5a-39ad-4ccc-ab38-a485b0870319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:12.715864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82cb5a-39ad-4ccc-ab38-a485b0870319 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.716184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82cb5a-39ad-4ccc-ab38-a485b0870319 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.717329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82cb5a-39ad-4ccc-ab38-a485b0870319 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.731202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82cb5a-39ad-4ccc-ab38-a485b0870319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-ee82cb5a-39ad-4ccc-ab38-a485b0870319 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:12.737279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:12.738132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:12.739306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 125/249] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:12.739968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adbafb-b193-4c77-a162-2fdd4d51ab75 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.739968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adbafb-b193-4c77-a162-2fdd4d51ab75 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.740082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adbafb-b193-4c77-a162-2fdd4d51ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.765142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d0adbafb-b193-4c77-a162-2fdd4d51ab75 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:12.766379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d0adbafb-b193-4c77-a162-2fdd4d51ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:12.825055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:12.845044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 126/250] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:12.845607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf8775-e0e9-40af-9e10-4a0136b44b99 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:12.845957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adbafb-b193-4c77-a162-2fdd4d51ab75 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:12.885321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:12.886172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:12.886584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:12.886989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:12.887920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] RBAC: Adding query filter params (role.id=06cd35fc6bd24aaebc92468b297664ce, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=08dcb227eb6c409a857a151995cc5524) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:12.888905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:12.890510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:12.901116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 125/251] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:12 2022] GET /identity/v3/role_assignments?user.id=08dcb227eb6c409a857a151995cc5524&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=06cd35fc6bd24aaebc92468b297664ce => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:13.001586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:13.022968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adbafb-b193-4c77-a162-2fdd4d51ab75 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:13.062412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53ae3e-7010-4d83-8861-bc63d726333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:13.063031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53ae3e-7010-4d83-8861-bc63d726333f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.063308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53ae3e-7010-4d83-8861-bc63d726333f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.063575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53ae3e-7010-4d83-8861-bc63d726333f None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.064241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53ae3e-7010-4d83-8861-bc63d726333f None admin] RBAC: Adding query filter params (name=member) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:13.064539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53ae3e-7010-4d83-8861-bc63d726333f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:13.065963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53ae3e-7010-4d83-8861-bc63d726333f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:13.075796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 127/252] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:13.081396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:13.211907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021771-771a-4cbd-bf8e-a1c747aaa067 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.212519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021771-771a-4cbd-bf8e-a1c747aaa067 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.213010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021771-771a-4cbd-bf8e-a1c747aaa067 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.214818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 128/253] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:13.220102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f0243-d66f-444c-86ca-a85b9bc8c25d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.220628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f0243-d66f-444c-86ca-a85b9bc8c25d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.221137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f0243-d66f-444c-86ca-a85b9bc8c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.239079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be888d9b-c0d4-4fbb-aee2-0de63f04f206 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:13.240218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-040f0243-d66f-444c-86ca-a85b9bc8c25d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:13.241625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-040f0243-d66f-444c-86ca-a85b9bc8c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:13.318306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 129/254] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:13.324937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:13.324937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.324937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.324937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] PATH_INFO: `/v3/users/e22f738d0f1948e9a491055af16a5c34` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.325275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=e22f738d0f1948e9a491055af16a5c34)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:13.325275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:13.329024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 126/255] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:13 2022] GET /identity/v3/users/e22f738d0f1948e9a491055af16a5c34 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:13.331228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f0243-d66f-444c-86ca-a85b9bc8c25d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:13.368362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:13.419653 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:13.421408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:13.443824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f0243-d66f-444c-86ca-a85b9bc8c25d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:13.477850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:13.478714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.479161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.479563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.480802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:13.482398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:13.484450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 130/256] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:13 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:13.490550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:13.571636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62835b8-684e-499f-bf14-ff1b04147ae6 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:13.607007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b292-6566-4203-b9e1-d77ccfb5c4d0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:13.645180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:13.646252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.646854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.647294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/e22f738d0f1948e9a491055af16a5c34/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.650121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5043e6fefe94a71a4b23176e17ce96b, user_id=e22f738d0f1948e9a491055af16a5c34, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:13.652078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:13.671873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 131/257] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:13 2022] PUT /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/e22f738d0f1948e9a491055af16a5c34/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:36:13.678585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:13.679264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.679605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.679889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.702068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:13.707601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:13.708486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:13.709313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 127/258] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:13.715235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:13.722800 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:13.798751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:13.911068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28d963-13d4-403d-9731-300ee5d741b9 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:13.937763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:13.963341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a91d4-4c61-4abc-b098-27170afde009 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:13.980454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:13.981343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:13.981830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:13.982276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:13.983110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:13.983578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:13.985205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:13.995417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 132/259] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:14.001623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:14.004503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:14.005485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:14.005906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:14.006483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:14.026108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:14.033112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:14.034039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:14.034822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:14.041017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 128/260] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:14.043790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:14.142478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:14.211779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3ec1b-ce18-49e8-b1ff-7b2f04fe55d4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:14.267011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ce17c-0cb4-46b6-8b49-b7bc6fa9d12c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:14.285606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:14.286283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:14.286646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:14.286923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] PATH_INFO: `/v3/users/5aad84384cc24f179f7f941ba4d41df9` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:14.289367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] RBAC: Authorizing `identity:get_user(user_id=5aad84384cc24f179f7f941ba4d41df9)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:14.291043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:14.292681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 133/261] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:14 2022] GET /identity/v3/users/5aad84384cc24f179f7f941ba4d41df9 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:14.298666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:14.335189 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:14.335819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:14.336098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:14.336400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:14.337201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:14.337413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:14.338828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:14.346049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:14.357447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 129/262] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:14.363763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:14.492155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b853386-d48d-4dd0-84ed-e186990089c7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:14.501837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87e4fb-63e5-4be9-aee9-02d38b327fa3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:14.539085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:14.540234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:14.540709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:14.541285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] PATH_INFO: `/v3/users/5aad84384cc24f179f7f941ba4d41df9` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:14.542659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] RBAC: Authorizing `identity:get_user(user_id=5aad84384cc24f179f7f941ba4d41df9)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:14.544340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:14.546514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 130/263] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:14 2022] GET /identity/v3/users/5aad84384cc24f179f7f941ba4d41df9 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:14.552212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:14.567356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:14.568344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:14.568835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:14.569338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:14.573141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:14.685552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:14.713503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:14.715004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:14.751123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0907f6-4dda-4f0c-ad76-9ae171b25290 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:14.792801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf9eb3-097f-42a9-a5f1-7d30ac8b31e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:14.793454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9eb3-097f-42a9-a5f1-7d30ac8b31e9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:14.793850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9eb3-097f-42a9-a5f1-7d30ac8b31e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:14.794283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf9eb3-097f-42a9-a5f1-7d30ac8b31e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:14.870356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9eb3-097f-42a9-a5f1-7d30ac8b31e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:14.872131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf9eb3-097f-42a9-a5f1-7d30ac8b31e9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:14.945309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:14.953894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 134/264] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:14.959350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:14.977839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 131/265] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:14.979520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86a56-2d67-4b36-b9fe-6ca67dae0236 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:14.979946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86a56-2d67-4b36-b9fe-6ca67dae0236 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:14.980534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c86a56-2d67-4b36-b9fe-6ca67dae0236 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:14.981976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 132/266] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:14.983709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c86a56-2d67-4b36-b9fe-6ca67dae0236 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:14.992853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:15.058005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6065dff-f54e-4c54-b782-d26c94250f60 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:15.093555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a07dc-fa03-43bd-be11-f4df60f32c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:15.094199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a07dc-fa03-43bd-be11-f4df60f32c68 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.094478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a07dc-fa03-43bd-be11-f4df60f32c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.094747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a07dc-fa03-43bd-be11-f4df60f32c68 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.096306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a07dc-fa03-43bd-be11-f4df60f32c68 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:15.097582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c86a56-2d67-4b36-b9fe-6ca67dae0236 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:15.097813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a07dc-fa03-43bd-be11-f4df60f32c68 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:15.099444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 135/267] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:14 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:15.100765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72ee3-0a2d-4ca7-9591-8b6109318876 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.101265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72ee3-0a2d-4ca7-9591-8b6109318876 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.101725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72ee3-0a2d-4ca7-9591-8b6109318876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.120544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-87b72ee3-0a2d-4ca7-9591-8b6109318876 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:15.122085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-87b72ee3-0a2d-4ca7-9591-8b6109318876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:15.138630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:15.139278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.139560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.139834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.141214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:15.142992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:15.145320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 133/268] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:14 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:15.146309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:15.193410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:15.272875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 136/269] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:15.273948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72ee3-0a2d-4ca7-9591-8b6109318876 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:15.301841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816e52-c6b0-406a-9f01-6c8a6465873f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:15.307070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:15.381629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72ee3-0a2d-4ca7-9591-8b6109318876 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:15.418321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e641d8-f58a-4608-a1e1-7b970f00d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:15.419198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e641d8-f58a-4608-a1e1-7b970f00d698 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.419618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e641d8-f58a-4608-a1e1-7b970f00d698 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.420018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e641d8-f58a-4608-a1e1-7b970f00d698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.420879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e641d8-f58a-4608-a1e1-7b970f00d698 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=5aad84384cc24f179f7f941ba4d41df9) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:15.421380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e641d8-f58a-4608-a1e1-7b970f00d698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:15.423049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e641d8-f58a-4608-a1e1-7b970f00d698 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:15.425645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3e598-d479-4975-9eed-b7322975bfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:15.426482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3e598-d479-4975-9eed-b7322975bfe3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.426596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3e598-d479-4975-9eed-b7322975bfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.426798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3e598-d479-4975-9eed-b7322975bfe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.427543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3e598-d479-4975-9eed-b7322975bfe3 None admin] RBAC: Adding query filter params (role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=5aad84384cc24f179f7f941ba4d41df9) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:15.427886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3e598-d479-4975-9eed-b7322975bfe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:15.429331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3e598-d479-4975-9eed-b7322975bfe3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:15.430267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 137/270] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:15 2022] GET /identity/v3/role_assignments?user.id=5aad84384cc24f179f7f941ba4d41df9&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:15.443480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 134/271] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:15 2022] GET /identity/v3/role_assignments?user.id=5aad84384cc24f179f7f941ba4d41df9&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:15.453491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed04ef3-4795-48b2-a0e9-07f9fcbd42ee None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.454012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed04ef3-4795-48b2-a0e9-07f9fcbd42ee None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.454423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed04ef3-4795-48b2-a0e9-07f9fcbd42ee None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.456189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 138/272] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:15.467514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd4d0-3178-4cc0-95f4-271c429f76dc None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.467800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd4d0-3178-4cc0-95f4-271c429f76dc None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.468078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd4d0-3178-4cc0-95f4-271c429f76dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.497603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-be1bd4d0-3178-4cc0-95f4-271c429f76dc None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:15.498832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-be1bd4d0-3178-4cc0-95f4-271c429f76dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:15.582168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 135/273] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:15.671952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed04ef3-4795-48b2-a0e9-07f9fcbd42ee None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:15.783793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:15.791007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed04ef3-4795-48b2-a0e9-07f9fcbd42ee None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:15.826493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44407f-912e-4e09-aea8-d943d66a8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:15.827129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44407f-912e-4e09-aea8-d943d66a8d22 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.827416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44407f-912e-4e09-aea8-d943d66a8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.827692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44407f-912e-4e09-aea8-d943d66a8d22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.838867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44407f-912e-4e09-aea8-d943d66a8d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-dd44407f-912e-4e09-aea8-d943d66a8d22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:15.844035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:15.844891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:15.845681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:15.849024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 139/274] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:15.851661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd4d0-3178-4cc0-95f4-271c429f76dc None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:15.882681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:15.921821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ddb05-9939-4d23-8933-904fca3a9e4c None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.922187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ddb05-9939-4d23-8933-904fca3a9e4c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.922365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ddb05-9939-4d23-8933-904fca3a9e4c None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.923737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 140/275] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:15.928924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8502-5d5d-4933-bf1c-4136d3b94601 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:15.929217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8502-5d5d-4933-bf1c-4136d3b94601 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:15.929493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f8502-5d5d-4933-bf1c-4136d3b94601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:15.954341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-159f8502-5d5d-4933-bf1c-4136d3b94601 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:15.956177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-159f8502-5d5d-4933-bf1c-4136d3b94601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:15.981156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd4d0-3178-4cc0-95f4-271c429f76dc None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.030070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.031293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.032184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.032961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.033641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:16.034185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:16.036263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:16.039541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 141/276] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:16.040194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8502-5d5d-4933-bf1c-4136d3b94601 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.049856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 136/277] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:16.055497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.158934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:16.169974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:16.173197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f8502-5d5d-4933-bf1c-4136d3b94601 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.185294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad93f28-1079-4849-ae84-e31d581637fd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.216465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.217517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.217891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.218636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.220117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:16.222533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:16.224469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 142/278] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:16.230140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.230616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.231439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.231856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.232267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] PATH_INFO: `/v3/users/ac77d815d9a34bb79a7bdfe7ca6b3f31` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.251075 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] RBAC: Authorizing `identity:get_user(user_id=ac77d815d9a34bb79a7bdfe7ca6b3f31)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:16.253361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:16.260613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 137/279] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/users/ac77d815d9a34bb79a7bdfe7ca6b3f31 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:16.262348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.350131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073f9a3-6cf7-4cc6-b7b0-642700bd1c28 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.379619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2e510-406b-4200-8abb-5a62005b1893 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.385156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.385764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.386039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.386312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.386952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:16.388386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:16.413402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 143/280] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:16 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:16.414593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.427849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741200c-9846-4baa-a51e-122544f34102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.429294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741200c-9846-4baa-a51e-122544f34102 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.429455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:16.430467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741200c-9846-4baa-a51e-122544f34102 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.430467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741200c-9846-4baa-a51e-122544f34102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.431938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741200c-9846-4baa-a51e-122544f34102 None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, user.id=ac77d815d9a34bb79a7bdfe7ca6b3f31, scope.system=all) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:16.432343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741200c-9846-4baa-a51e-122544f34102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:16.434186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741200c-9846-4baa-a51e-122544f34102 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:16.441656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 138/281] 10.222.0.13 () {56 vars in 1308 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/role_assignments?user.id=ac77d815d9a34bb79a7bdfe7ca6b3f31&scope.system=all&role.id=ad683698d38f4826b4af8e1069955c8e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:16.470423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba817b5-dfa3-49f3-84c3-52cb517dbe12 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.470843 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba817b5-dfa3-49f3-84c3-52cb517dbe12 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.470960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba817b5-dfa3-49f3-84c3-52cb517dbe12 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.473385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 139/282] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:16.479587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716752-9153-440b-a514-5aa2aed2b1d6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.479908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716752-9153-440b-a514-5aa2aed2b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.480185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716752-9153-440b-a514-5aa2aed2b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.501820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4b716752-9153-440b-a514-5aa2aed2b1d6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:16.503386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4b716752-9153-440b-a514-5aa2aed2b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:16.518334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:16.552435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1cdf3-e6c6-4ede-a47f-e5e57cfd4f79 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.605302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.605963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.606243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.606514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.609445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 140/283] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:16.619338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:16.624646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:16.625587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:16.626350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 144/284] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:16.633413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716752-9153-440b-a514-5aa2aed2b1d6 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.738857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716752-9153-440b-a514-5aa2aed2b1d6 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.775383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.776347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.776806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.777258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.778197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:16.778693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:16.780294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:16.789749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 141/285] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:16.795370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.867658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:16.885400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:16.894043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:16.901136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142b11a-9c09-4570-8074-431ad687e079 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:16.943646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:16.944292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:16.944569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:16.944838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] PATH_INFO: `/v3/users/08dcb227eb6c409a857a151995cc5524` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:16.947714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] RBAC: Authorizing `identity:get_user(user_id=08dcb227eb6c409a857a151995cc5524)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:16.949200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:16.950883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 145/286] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/users/08dcb227eb6c409a857a151995cc5524 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:16.958009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:17.056647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6411548-cf49-45a6-83c8-8deb35b0485f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:17.119098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:17.120133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:17.120441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de748332-3db1-4b13-b7e5-4d07dc425dda None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:17.120816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:17.121302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:17.144673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:17.150932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:17.151809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:17.152575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:17.155300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 142/287] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:17.160804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:17.179649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:17.180357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:17.180637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:17.180940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:17.183630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:17.185124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:17.186944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 146/288] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:16 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:17.192743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:17.207505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:17.268754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:17.346544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a25d3-8172-43b6-994a-30c1ca422219 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:17.394138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c441a-e60a-4fb0-a9a7-ecd91b3d422f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:17.419102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:17.420396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:17.420863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:17.421352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:17.422219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:17.422743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:17.424378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:17.436672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:17.437376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:17.437657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:17.437930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/08dcb227eb6c409a857a151995cc5524/roles/06cd35fc6bd24aaebc92468b297664ce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:17.446375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] RBAC: Authorizing `identity:create_grant(project_id=a5043e6fefe94a71a4b23176e17ce96b, user_id=08dcb227eb6c409a857a151995cc5524, role_id=06cd35fc6bd24aaebc92468b297664ce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:17.447842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:17.450062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 143/289] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:17.453834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:17.472544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 147/290] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:17 2022] PUT /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/users/08dcb227eb6c409a857a151995cc5524/roles/06cd35fc6bd24aaebc92468b297664ce => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:17.606895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8179eb-34b5-4f25-9b28-a484811fd137 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:17.640802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:17.653137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:17.653789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:17.654069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:17.654426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] PATH_INFO: `/v3/users/e22f738d0f1948e9a491055af16a5c34` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:17.655832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] RBAC: Authorizing `identity:get_user(user_id=e22f738d0f1948e9a491055af16a5c34)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:17.657380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:17.659270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 144/291] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:17 2022] GET /identity/v3/users/e22f738d0f1948e9a491055af16a5c34 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:17.665302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:17.749393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:17.793400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a9f0-3e93-43ac-bc08-9eea42deac8e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:17.838757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:17.841686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:17.842166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:17.842685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:17.944543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:17.946125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:18.032312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:18.085192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 148/292] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:18.090525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:18.238026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc8d4e-f6ce-459b-adf7-b0b206bc5520 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:18.283422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a20ec-5c1e-4732-9a9d-ba4f152954fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:18.284451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a20ec-5c1e-4732-9a9d-ba4f152954fa None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:18.284960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a20ec-5c1e-4732-9a9d-ba4f152954fa None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:18.285419 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a20ec-5c1e-4732-9a9d-ba4f152954fa None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:18.286708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a20ec-5c1e-4732-9a9d-ba4f152954fa None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:18.288327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a20ec-5c1e-4732-9a9d-ba4f152954fa None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:18.290244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 145/293] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:18 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:18.296381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:18.441034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c97b9-be5d-4b77-87d2-01571ea591c2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:18.479795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e6779-422b-4914-a9e3-e24d7469517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:18.480408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6779-422b-4914-a9e3-e24d7469517f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:18.480688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6779-422b-4914-a9e3-e24d7469517f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:18.480990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e6779-422b-4914-a9e3-e24d7469517f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:18.481725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6779-422b-4914-a9e3-e24d7469517f None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=e22f738d0f1948e9a491055af16a5c34) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:18.482033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6779-422b-4914-a9e3-e24d7469517f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:18.483473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e6779-422b-4914-a9e3-e24d7469517f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:18.496772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 149/294] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:18 2022] GET /identity/v3/role_assignments?user.id=e22f738d0f1948e9a491055af16a5c34&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=ad683698d38f4826b4af8e1069955c8e => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:18.670472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5490a51-2333-4d76-9079-83b843c03083 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:18.670975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5490a51-2333-4d76-9079-83b843c03083 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:18.671047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5490a51-2333-4d76-9079-83b843c03083 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:18.672508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 146/295] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:18.678146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d8d9-372f-4d8e-b5bd-428c8249d86c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:18.678435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d8d9-372f-4d8e-b5bd-428c8249d86c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:18.678774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d8d9-372f-4d8e-b5bd-428c8249d86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:18.698015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-03f5d8d9-372f-4d8e-b5bd-428c8249d86c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:18.699273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-03f5d8d9-372f-4d8e-b5bd-428c8249d86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:18.725467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:18.778026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 150/296] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:19.004590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca7bc1-26f9-4560-b839-0599bc2a04ee None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.005162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca7bc1-26f9-4560-b839-0599bc2a04ee None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.005568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca7bc1-26f9-4560-b839-0599bc2a04ee None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.007326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 147/297] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:19.013472 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba6d3-43b7-4181-9c62-97e0ddd93b1a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.014311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba6d3-43b7-4181-9c62-97e0ddd93b1a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.014785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ba6d3-43b7-4181-9c62-97e0ddd93b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.035420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-778ba6d3-43b7-4181-9c62-97e0ddd93b1a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:19.036865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-778ba6d3-43b7-4181-9c62-97e0ddd93b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:19.078358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca7bc1-26f9-4560-b839-0599bc2a04ee None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.106657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 151/298] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:19.147182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:19.179023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed7dd9-20f3-4853-b212-05b023b69561 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.179322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed7dd9-20f3-4853-b212-05b023b69561 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.179573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed7dd9-20f3-4853-b212-05b023b69561 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.181251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 152/299] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:19.186217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a1225-80d7-466b-8708-3c80248b63cd None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.186556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a1225-80d7-466b-8708-3c80248b63cd None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.186953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a1225-80d7-466b-8708-3c80248b63cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.188308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca7bc1-26f9-4560-b839-0599bc2a04ee None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.205700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-130a1225-80d7-466b-8708-3c80248b63cd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:19.207165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-130a1225-80d7-466b-8708-3c80248b63cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:19.227320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.228389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.228673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.229258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.242724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:19.249311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:19.250180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:19.250963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:19.251700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 148/300] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:19.257695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.285170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 153/301] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:19.363741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b617d05-2127-418d-9425-d7fa043799cc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.387761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:19.400428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.401291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.401743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.402185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.403017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:19.403511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:19.405127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:19.418437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 149/302] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:19.420854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.421002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a1225-80d7-466b-8708-3c80248b63cd None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.448547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:19.526805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a05f8-8092-4899-bcdb-830f735e1dba None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.532293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a1225-80d7-466b-8708-3c80248b63cd None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.562646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.563224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.563504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.563917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.568460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.569070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.569356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.569629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] PATH_INFO: `/v3/users/ac77d815d9a34bb79a7bdfe7ca6b3f31` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.570955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] RBAC: Authorizing `identity:get_user(user_id=ac77d815d9a34bb79a7bdfe7ca6b3f31)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:19.572780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:19.574562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:19.574665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 154/303] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:19 2022] GET /identity/v3/users/ac77d815d9a34bb79a7bdfe7ca6b3f31 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:19.577810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:19.579914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:19.580782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 150/304] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:19.586652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.631817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:19.678377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:19.687243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906c97e-b4ea-48f1-a9f7-5003adcaf72a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.691651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25de46d-d791-4233-bef0-900a5fe17692 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.722119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71310913-fca8-4501-9465-ddd4372793f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.722782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310913-fca8-4501-9465-ddd4372793f2 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.723068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310913-fca8-4501-9465-ddd4372793f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.723340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310913-fca8-4501-9465-ddd4372793f2 None admin] PATH_INFO: `/v3/system/users/ac77d815d9a34bb79a7bdfe7ca6b3f31/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.724724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71310913-fca8-4501-9465-ddd4372793f2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac77d815d9a34bb79a7bdfe7ca6b3f31, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:19.725264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.725911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.726164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71310913-fca8-4501-9465-ddd4372793f2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:19.726260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.726445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.727873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:19.729666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:19.730955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 155/305] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:19.731799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.737012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 151/306] 10.222.0.13 () {58 vars in 1334 bytes} [Sat Sep 3 03:36:19 2022] PUT /identity/v3/system/users/ac77d815d9a34bb79a7bdfe7ca6b3f31/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:19.738475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060fed-c4eb-434c-9832-d3858293feea None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.738766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060fed-c4eb-434c-9832-d3858293feea None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.739040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060fed-c4eb-434c-9832-d3858293feea None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.740789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 152/307] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:19.741920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a060fed-c4eb-434c-9832-d3858293feea None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.839808 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0392a2-95e7-4874-a8b6-c224ed42abd2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.867642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a060fed-c4eb-434c-9832-d3858293feea None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:19.878167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:19.881594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc39fc-26b0-4202-a583-4621404c510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.882293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc39fc-26b0-4202-a583-4621404c510b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.883019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc39fc-26b0-4202-a583-4621404c510b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.883019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc39fc-26b0-4202-a583-4621404c510b None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.883511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc39fc-26b0-4202-a583-4621404c510b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:19.883816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc39fc-26b0-4202-a583-4621404c510b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:19.885255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc39fc-26b0-4202-a583-4621404c510b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:19.894695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 156/308] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:19.895926 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6eaa-edcb-4ff2-b1e7-ce285aaaf05f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.896211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6eaa-edcb-4ff2-b1e7-ce285aaaf05f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.896483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c6eaa-edcb-4ff2-b1e7-ce285aaaf05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.910693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:19.911532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:19.911948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:19.912375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] PATH_INFO: `/v3/groups` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:19.913171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:19.915119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:19.919428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ac0c6eaa-edcb-4ff2-b1e7-ce285aaaf05f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:19.920612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ac0c6eaa-edcb-4ff2-b1e7-ce285aaaf05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:19.932724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 153/309] 10.222.0.13 () {60 vars in 1134 bytes} [Sat Sep 3 03:36:19 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:19.933589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:19.939724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:20.008352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 157/310] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:20.049038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77966-3632-4862-92d7-e44c3100dc05 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:20.086497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:20.087461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:20.087808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:20.088087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] PATH_INFO: `/v3/users/36707ea6f8674766ace925918df482aa` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:20.102593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] RBAC: Authorizing `identity:get_user(user_id=36707ea6f8674766ace925918df482aa)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:20.104179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:20.105881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 154/311] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:19 2022] GET /identity/v3/users/36707ea6f8674766ace925918df482aa => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:20.112283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6eaa-edcb-4ff2-b1e7-ce285aaaf05f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:20.229555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c6eaa-edcb-4ff2-b1e7-ce285aaaf05f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:20.266158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:20.266772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:20.267050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:20.267323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:20.268045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] RBAC: Adding query filter params (role.id=06cd35fc6bd24aaebc92468b297664ce, user.id=36707ea6f8674766ace925918df482aa, scope.system=all) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:20.268348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:20.269876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:20.275904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 158/312] 10.222.0.13 () {56 vars in 1308 bytes} [Sat Sep 3 03:36:20 2022] GET /identity/v3/role_assignments?user.id=36707ea6f8674766ace925918df482aa&scope.system=all&role.id=06cd35fc6bd24aaebc92468b297664ce => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:20.284581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:20.315974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:20.399270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc881-bb51-414f-8090-aee26296dd2e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:20.440194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:20.441345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:20.441818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:20.444038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:20.455931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:20.461113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:20.462151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:20.462915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:20.465107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 155/313] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:20.474158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:20.503383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:20.648175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22502a-ac5a-4eee-af56-519c2267057a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:20.702144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:20.703074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:20.703545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:20.704052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:20.705249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:20.705765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:20.708182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:20.722703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 159/314] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:20.731564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:20.835811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:20.851045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e5aab-67da-4e02-8b24-99433d8ec6fd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:20.887331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:20.887996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:20.888276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:20.888547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] PATH_INFO: `/v3/users/08dcb227eb6c409a857a151995cc5524` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:20.889806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] RBAC: Authorizing `identity:get_user(user_id=08dcb227eb6c409a857a151995cc5524)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:20.891292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:20.893140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 156/315] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:20 2022] GET /identity/v3/users/08dcb227eb6c409a857a151995cc5524 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:20.898850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:20.977732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:21.002942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e166e-1797-4fbb-a82a-a2988f3b8182 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:21.036213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:21.036819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:21.037126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:21.037396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:21.103417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:21.104938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:21.184862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:21.209503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 160/316] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:21.215014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:21.323614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdcc84-6ba1-497d-a5a3-4c9fb330de91 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:21.359033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e3941-b9e8-438d-a945-c07955eec2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:21.359675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3941-b9e8-438d-a945-c07955eec2c6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:21.359953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3941-b9e8-438d-a945-c07955eec2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:21.360224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3941-b9e8-438d-a945-c07955eec2c6 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:21.361685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e3941-b9e8-438d-a945-c07955eec2c6 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:21.363132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e3941-b9e8-438d-a945-c07955eec2c6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:21.365081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 157/317] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:21 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:21.374059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:21.474536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57e536-435f-4ec0-9246-7f687781cfa1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:21.516935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1374ea1-71c4-445b-800b-ca74e8b7904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:21.517549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374ea1-71c4-445b-800b-ca74e8b7904b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:21.517825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374ea1-71c4-445b-800b-ca74e8b7904b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:21.518091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374ea1-71c4-445b-800b-ca74e8b7904b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:21.518818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374ea1-71c4-445b-800b-ca74e8b7904b None admin] RBAC: Adding query filter params (role.id=06cd35fc6bd24aaebc92468b297664ce, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b, user.id=08dcb227eb6c409a857a151995cc5524) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:21.519120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374ea1-71c4-445b-800b-ca74e8b7904b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:21.520551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374ea1-71c4-445b-800b-ca74e8b7904b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:21.534814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 161/318] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:21 2022] GET /identity/v3/role_assignments?user.id=08dcb227eb6c409a857a151995cc5524&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=06cd35fc6bd24aaebc92468b297664ce => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:21.734353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ea4d-0a91-48e0-ae4e-1a0fbe519daf None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:21.735063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ea4d-0a91-48e0-ae4e-1a0fbe519daf None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:21.735063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64ea4d-0a91-48e0-ae4e-1a0fbe519daf None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:21.736767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 158/319] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:21.742278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0d801-f220-40e1-b227-240f5b140f62 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:21.742636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0d801-f220-40e1-b227-240f5b140f62 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:21.742917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0d801-f220-40e1-b227-240f5b140f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:21.761612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-34a0d801-f220-40e1-b227-240f5b140f62 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:21.762791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-34a0d801-f220-40e1-b227-240f5b140f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:21.794236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:21.831807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 162/320] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:22.084563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343c72b-ab80-4ec4-a977-85d32b8bdffd None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.084758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343c72b-ab80-4ec4-a977-85d32b8bdffd None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.085055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343c72b-ab80-4ec4-a977-85d32b8bdffd None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.086601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 159/321] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:22.092152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc965-88e6-4455-ab76-6798609c87c0 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.092404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc965-88e6-4455-ab76-6798609c87c0 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.092710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc965-88e6-4455-ab76-6798609c87c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.108150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343c72b-ab80-4ec4-a977-85d32b8bdffd None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:22.112134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c2dcc965-88e6-4455-ab76-6798609c87c0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:22.113353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c2dcc965-88e6-4455-ab76-6798609c87c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:22.133945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:22.191990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 163/322] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:22.223989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343c72b-ab80-4ec4-a977-85d32b8bdffd None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:22.258762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446a6fa-5cfb-47c0-ae99-9e2ba924cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:22.259399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a6fa-5cfb-47c0-ae99-9e2ba924cf09 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.259675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a6fa-5cfb-47c0-ae99-9e2ba924cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.259925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446a6fa-5cfb-47c0-ae99-9e2ba924cf09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.270379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446a6fa-5cfb-47c0-ae99-9e2ba924cf09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4446a6fa-5cfb-47c0-ae99-9e2ba924cf09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:22.275345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:22.276213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:22.281870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 160/323] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:22.282512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc965-88e6-4455-ab76-6798609c87c0 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:22.329079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347c00-05ea-4af5-a673-1196981a98bb None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.329380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347c00-05ea-4af5-a673-1196981a98bb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.329645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347c00-05ea-4af5-a673-1196981a98bb None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.331255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 161/324] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:22.335967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4380e7-3e68-41b0-a4df-b5d561fab2b1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.336259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4380e7-3e68-41b0-a4df-b5d561fab2b1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.336547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4380e7-3e68-41b0-a4df-b5d561fab2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.355672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ac4380e7-3e68-41b0-a4df-b5d561fab2b1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:22.356856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ac4380e7-3e68-41b0-a4df-b5d561fab2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:22.381592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:22.386864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc965-88e6-4455-ab76-6798609c87c0 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:22.424712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:22.425547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.425841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:22.426107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.426550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.427342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] RBAC: Adding query filter params (name=member) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:22.427777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:22.429318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:22.437946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 164/326] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:22.443560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4380e7-3e68-41b0-a4df-b5d561fab2b1 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:22.459992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:22.464339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:22.561264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4380e7-3e68-41b0-a4df-b5d561fab2b1 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:22.568779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c528504-b649-4df1-a25e-3a90887c3813 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:22.595458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:22.596022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.596303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.596579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] PATH_INFO: `/v3/users/ac77d815d9a34bb79a7bdfe7ca6b3f31` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.597736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] RBAC: Authorizing `identity:get_user(user_id=ac77d815d9a34bb79a7bdfe7ca6b3f31)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:22.599199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:22.600786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 163/327] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:22 2022] GET /identity/v3/users/ac77d815d9a34bb79a7bdfe7ca6b3f31 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:22.607723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:22.612026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:22.612666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.612978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.613257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.614361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:22.615795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:22.617560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 165/328] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:22.623621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:22.660680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:22.697260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:22.716671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a09cf-4c34-4039-83d4-50a2032e8d72 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:22.734819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0901f7-2d83-4909-b0c5-4e68f6b377d7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:22.750269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:22.750872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.751151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.751424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.752142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] RBAC: Adding query filter params (role.id=ad683698d38f4826b4af8e1069955c8e, user.id=ac77d815d9a34bb79a7bdfe7ca6b3f31, scope.system=all) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:22.752449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:22.753924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:22.765869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 164/329] 10.222.0.13 () {56 vars in 1308 bytes} [Sat Sep 3 03:36:22 2022] GET /identity/v3/role_assignments?user.id=ac77d815d9a34bb79a7bdfe7ca6b3f31&scope.system=all&role.id=ad683698d38f4826b4af8e1069955c8e => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:22.766620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:22.769276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:22.770076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.770354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.770626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] PATH_INFO: `/v3/groups` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.771291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:22.772761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:22.808947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 166/330] 10.222.0.13 () {60 vars in 1134 bytes} [Sat Sep 3 03:36:22 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:36:22.882892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50dadb-f591-4f41-82ab-f7d30b86d98c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:22.930635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:22.931288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:22.931567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:22.931838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:22.940038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:22.947423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:22.952339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:22.953324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:22.954105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 165/331] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:22.959610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:23.050983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:23.064163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182276-3bcd-4f76-b67c-660dfd5d67d4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:23.100807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:23.101458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:23.101790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:23.102075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:23.103043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:23.103346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:23.104834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:23.114098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 167/332] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:23.119820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:23.236755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b9ae5-4e66-4827-b255-5b089c99bdc8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:23.277138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380581f-0964-4265-9172-11bdc69347d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:23.278217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380581f-0964-4265-9172-11bdc69347d8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:23.278793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380581f-0964-4265-9172-11bdc69347d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:23.279116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380581f-0964-4265-9172-11bdc69347d8 None admin] PATH_INFO: `/v3/users/36707ea6f8674766ace925918df482aa` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:23.280270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380581f-0964-4265-9172-11bdc69347d8 None admin] RBAC: Authorizing `identity:get_user(user_id=36707ea6f8674766ace925918df482aa)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:23.281815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380581f-0964-4265-9172-11bdc69347d8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:23.283712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 166/333] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:23 2022] GET /identity/v3/users/36707ea6f8674766ace925918df482aa => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:23.289153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:23.399586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c34a2-8c4e-476f-aa9b-baa05c1ad8aa None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:23.436078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754ba1-faaf-4f10-9601-7df08d25bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:23.437118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754ba1-faaf-4f10-9601-7df08d25bd07 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:23.437598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754ba1-faaf-4f10-9601-7df08d25bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:23.438143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754ba1-faaf-4f10-9601-7df08d25bd07 None admin] PATH_INFO: `/v3/system/users/36707ea6f8674766ace925918df482aa/roles/06cd35fc6bd24aaebc92468b297664ce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:23.439892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754ba1-faaf-4f10-9601-7df08d25bd07 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36707ea6f8674766ace925918df482aa, role_id=06cd35fc6bd24aaebc92468b297664ce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:23.441693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754ba1-faaf-4f10-9601-7df08d25bd07 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:23.456838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 168/334] 10.222.0.13 () {58 vars in 1334 bytes} [Sat Sep 3 03:36:23 2022] PUT /identity/v3/system/users/36707ea6f8674766ace925918df482aa/roles/06cd35fc6bd24aaebc92468b297664ce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:25.159780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d384a-83cc-47c8-a6fd-5f2854e545a6 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.160834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d384a-83cc-47c8-a6fd-5f2854e545a6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.161345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d384a-83cc-47c8-a6fd-5f2854e545a6 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.163747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 167/335] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:25.170322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7155b-224e-47d0-828b-201d68adce70 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.171185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7155b-224e-47d0-828b-201d68adce70 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.171662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7155b-224e-47d0-828b-201d68adce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.196551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1bf7155b-224e-47d0-828b-201d68adce70 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:25.198118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1bf7155b-224e-47d0-828b-201d68adce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:25.213508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:25.287134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 169/336] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:25.505159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba40c98-6d09-42ef-a3c5-3d0649559133 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.505572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba40c98-6d09-42ef-a3c5-3d0649559133 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.505961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba40c98-6d09-42ef-a3c5-3d0649559133 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.507582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 168/337] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:25.513330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9198d-094a-4570-9751-68ab7c0ca274 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.513619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9198d-094a-4570-9751-68ab7c0ca274 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.513893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9198d-094a-4570-9751-68ab7c0ca274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.537152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9ab9198d-094a-4570-9751-68ab7c0ca274 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:25.538345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9ab9198d-094a-4570-9751-68ab7c0ca274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:25.581376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94e1d-d2e3-460b-987d-81bbdd2119b6 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.581704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94e1d-d2e3-460b-987d-81bbdd2119b6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.581920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f94e1d-d2e3-460b-987d-81bbdd2119b6 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.583571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 169/338] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:25.592575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11e44-49d5-4c0b-8f12-4d5586d18b4a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.592862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11e44-49d5-4c0b-8f12-4d5586d18b4a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.593251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11e44-49d5-4c0b-8f12-4d5586d18b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.615655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 170/339] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:25.634391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-94b11e44-49d5-4c0b-8f12-4d5586d18b4a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:25.635621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-94b11e44-49d5-4c0b-8f12-4d5586d18b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:25.699722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9198d-094a-4570-9751-68ab7c0ca274 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:25.718910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:25.739199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 170/340] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:25.808882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a3b39-b9c4-4d3d-8416-67ba43d700a8 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.809082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a3b39-b9c4-4d3d-8416-67ba43d700a8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.809293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:25.809405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a3b39-b9c4-4d3d-8416-67ba43d700a8 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.811678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 171/341] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:25.816024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764b582-d079-4e59-be2a-d45b7b16132c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.816309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764b582-d079-4e59-be2a-d45b7b16132c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.816580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764b582-d079-4e59-be2a-d45b7b16132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.842849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9198d-094a-4570-9751-68ab7c0ca274 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:25.861107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7764b582-d079-4e59-be2a-d45b7b16132c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:25.862637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7764b582-d079-4e59-be2a-d45b7b16132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:25.886528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:25.887184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:25.887468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:25.887741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:25.912553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:25.926351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:25.927259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:25.928041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 171/342] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:25.935464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.013316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 172/343] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:26.061916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d860-b4ca-4d37-b5d7-ba5be0bf5bac None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.101508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:26.102206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:26.102553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:26.102972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:26.103652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:26.103961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:26.105445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:26.110623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764b582-d079-4e59-be2a-d45b7b16132c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.114404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 172/344] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:26.116856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:26.124537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.249553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cce4c-d5ed-436f-b932-b827a921d685 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.292018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:26.292651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:26.292956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:26.293232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:26.335049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764b582-d079-4e59-be2a-d45b7b16132c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.378171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:26.389196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:26.390691 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:26.401614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:26.402093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:26.402751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:26.403033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:26.403310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:26.431378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:26.437965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:26.438838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:26.439636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:26.443652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 173/345] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:26.445053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.522257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 173/346] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:26.523598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.573045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce114088-e3e3-4f91-bd12-43d278fbb12f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.622432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:26.623025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:26.623303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:26.623574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:26.636678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:26.638253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:26.642127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:26.643096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:26.643904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 174/347] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:26.644548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.649366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb87d-283c-45bc-9e4b-d828c89ed43e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.685802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:26.686868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:26.687352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:26.687879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:26.700529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:26.705900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:26.706815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:26.707622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:26.709538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:26.710489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 174/348] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:26.711846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.780884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6bb1-ad5f-42de-8e1b-bd26678520dc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.824211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:26.824846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:26.825167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:26.825438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:26.825686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611c27-5de0-4632-a63e-9c24ebf9e4ed None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.826106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:26.826405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:26.827901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:26.838077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 175/349] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:26.838990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.863310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:26.864362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:26.864836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:26.865331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:26.866675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:26.868462 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:26.870520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 175/350] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:26.871515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:26.898708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:26.969736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f1fda-bf6e-435b-bf24-73eb1134a572 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:26.980283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:26.983397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d74a5-3412-4f2a-9b7b-a39123d21d53 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.010637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.011649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.012136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.012591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.013596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:27.014180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.015739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.021885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.022504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.022784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.023059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.023907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:27.024346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.025765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.026850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 176/351] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:27.027935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.035197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 176/352] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:27.036077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.136549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:27.149533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5248be-6370-4048-b99a-a71c7d5738e7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.152616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776399f-3dca-4d55-ac7e-5221cfb3c4c7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.193757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.194717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.195000 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.195276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.204132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.205632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.207311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 177/353] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:27.208090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.213446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62b68-00a0-4702-ad0a-ef151ca17aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.214130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62b68-00a0-4702-ad0a-ef151ca17aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.214422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62b68-00a0-4702-ad0a-ef151ca17aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.214740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62b68-00a0-4702-ad0a-ef151ca17aa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.266449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:27.307483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62b68-00a0-4702-ad0a-ef151ca17aa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.309687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62b68-00a0-4702-ad0a-ef151ca17aa9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.331065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ac97-9c80-4760-bc05-40c46b916995 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.374927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.375569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.375848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.376120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] PATH_INFO: `/v3/users/36707ea6f8674766ace925918df482aa` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.377294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] RBAC: Authorizing `identity:get_user(user_id=36707ea6f8674766ace925918df482aa)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.378744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.380339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 178/354] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/users/36707ea6f8674766ace925918df482aa => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:27.381157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.404871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:27.430190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 177/355] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:27.432135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979888a-64cd-4567-b957-32dbabd0d9ed None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.432609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979888a-64cd-4567-b957-32dbabd0d9ed None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.433124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979888a-64cd-4567-b957-32dbabd0d9ed None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.434505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 178/356] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:27.435296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979888a-64cd-4567-b957-32dbabd0d9ed None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.501656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c21f15-80a7-4b65-b41b-91d0e8bcad82 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.519097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:27.546673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8db75-20b6-4253-8175-e7c33ca89f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.547214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8db75-20b6-4253-8175-e7c33ca89f0a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.547498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8db75-20b6-4253-8175-e7c33ca89f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.547775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8db75-20b6-4253-8175-e7c33ca89f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.557849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979888a-64cd-4567-b957-32dbabd0d9ed None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.599951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05954712-4f77-4dff-9e47-6037bf262fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.600588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05954712-4f77-4dff-9e47-6037bf262fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.600892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05954712-4f77-4dff-9e47-6037bf262fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.601170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05954712-4f77-4dff-9e47-6037bf262fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.601924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05954712-4f77-4dff-9e47-6037bf262fa0 None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=1fe42e1edb77415999b8e4fed6094dce) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:27.602231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05954712-4f77-4dff-9e47-6037bf262fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.603731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05954712-4f77-4dff-9e47-6037bf262fa0 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.617148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 179/357] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:27.619273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df778ae-5c0f-4563-9343-4c28bc87aec2 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.619561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df778ae-5c0f-4563-9343-4c28bc87aec2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.619950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df778ae-5c0f-4563-9343-4c28bc87aec2 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.621596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 180/358] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:27.622267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df778ae-5c0f-4563-9343-4c28bc87aec2 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.631212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8db75-20b6-4253-8175-e7c33ca89f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.632727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8db75-20b6-4253-8175-e7c33ca89f0a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.655996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:27.772741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 179/359] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:27.775060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df778ae-5c0f-4563-9343-4c28bc87aec2 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.775176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab5fd-baac-4cf4-8a2c-20556897cafd None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.775342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab5fd-baac-4cf4-8a2c-20556897cafd None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.775618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aab5fd-baac-4cf4-8a2c-20556897cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.797750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e9aab5fd-baac-4cf4-8a2c-20556897cafd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:27.799413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e9aab5fd-baac-4cf4-8a2c-20556897cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:27.816749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.817453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.817881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.818164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.819274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] RBAC: Adding query filter params (role.id=06cd35fc6bd24aaebc92468b297664ce, user.id=36707ea6f8674766ace925918df482aa, scope.system=all) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:27.819724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:27.821850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:27.825777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:27.842802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 181/360] 10.222.0.13 () {56 vars in 1308 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/role_assignments?user.id=36707ea6f8674766ace925918df482aa&scope.system=all&role.id=06cd35fc6bd24aaebc92468b297664ce => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:27.843006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.885639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 180/361] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:27.886939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962093c4-37d0-4aa8-8dd8-3ac1288990b0 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:27.887225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962093c4-37d0-4aa8-8dd8-3ac1288990b0 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:27.887502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962093c4-37d0-4aa8-8dd8-3ac1288990b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:27.906706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-962093c4-37d0-4aa8-8dd8-3ac1288990b0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:27.907945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-962093c4-37d0-4aa8-8dd8-3ac1288990b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:27.958217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29fbba-90cf-45b2-9ed6-636458da6bdc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:27.958971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:27.988530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 181/362] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:27.989421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962093c4-37d0-4aa8-8dd8-3ac1288990b0 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:27.999332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:27.999985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.000268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.000544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.001871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:28.003444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:28.005700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 182/363] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:28.011674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.078745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:28.107579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962093c4-37d0-4aa8-8dd8-3ac1288990b0 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.124649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b12e9e-3473-43fc-8047-0df906199447 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.147546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.148200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.148510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.149213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.150500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:28.152070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:28.153901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 182/364] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:27 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:28.159596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.182211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.183109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.183531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.183978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.185655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:28.187276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:28.191125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 183/365] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:28.197657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.213307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:28.269411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9bd0e-f6a7-4193-a336-bda5c671adf9 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.310170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.310822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.311108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.311389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.316938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:28.316938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:28.316938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 183/366] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:28.322020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.401975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7246a-0898-4f2f-a5da-8df272a07e7d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.443011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:28.453546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.454156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.454434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.454702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.455425 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=1fe42e1edb77415999b8e4fed6094dce) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:28.455727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:28.457199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:28.462906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 184/367] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=ad683698d38f4826b4af8e1069955c8e => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:28.469023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.472649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5701afd-f722-476c-941a-0433e52d0d26 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.490116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:28.521284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.522151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.522589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.522992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.524412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:28.524905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:28.526710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:28.533984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 184/368] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=ad683698d38f4826b4af8e1069955c8e => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:28.535155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.635102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaa9d3-eb36-4b1f-ad8e-2c006a82cf06 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.685119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.685770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.686106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.686387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.701577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:28.711213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:28.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:28.712998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 185/369] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:28.720361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.721086 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfdf8e-cd75-4482-8c59-8d15b0f62bce None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.767356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.768016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.768331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.768569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.786152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:28.791521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:28.798237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:28.799112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:28.800461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 185/370] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:28.814064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.850924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca5005-3e0f-4741-8bc8-48d66c186217 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.872143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:28.899334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.900142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.900523 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.900801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.901518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:28.901824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:28.903228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:28.912837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 186/371] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:28.919271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:28.946342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74b13f-7542-4e99-884a-153224c2d697 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:28.995053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:28.995600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:28.995865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:28.996136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:28.996800 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:28.999218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.000621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.009907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 186/372] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:29.027728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:29.075406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf9921-d6ef-49b9-ba70-9305d4ac654b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.093385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:29.118465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.119084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.119367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.119642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.174318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:29.178727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1362e12-37f1-4d7f-af87-d6a739a9ef57 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.197002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.198758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.219831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.220441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.220719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.221019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.295374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.296769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.308680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 187/373] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:29.314894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:29.331456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:29.397187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:29.402616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 187/374] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:29.408717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:29.434540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a3484-782f-440c-98d5-c3f545713640 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.471191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.472596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.473138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.473607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.474938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.476610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.478879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 188/375] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:29 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:29.484094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:29.520944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a6aa0-8299-480d-bf9e-d467d8a7108a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.558946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.558946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.558946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.558946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] PATH_INFO: `/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.561674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] RBAC: Authorizing `identity:get_project(project_id=b003f3768dcc465bb9a5bba73f3a6b18)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.563055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.565031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 188/376] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:29 2022] GET /identity/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:29.582556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:29.603173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:29.623900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc93e4-354a-43a0-9f5c-590c570bca64 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.660530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.661379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.661760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.662133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.663347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.665172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.667192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 189/377] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:29 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:29.672717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:29.678850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:29.715418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0554d6-e4bb-4df1-8001-968ca6e78a33 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.753525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.754539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.755031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.755485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] PATH_INFO: `/v3/groups/cba8ec5915a4443591aae51f81cb9ccf` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.761059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] RBAC: Authorizing `identity:get_group(group_id=cba8ec5915a4443591aae51f81cb9ccf)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.762728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.764884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 189/378] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:29 2022] GET /identity/v3/groups/cba8ec5915a4443591aae51f81cb9ccf => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:29.771468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:29.795700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392c76-bd44-43b8-be0f-670e99747194 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.833882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007d79-e695-44e1-905b-0fb278c6fdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.834454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007d79-e695-44e1-905b-0fb278c6fdae None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.834690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007d79-e695-44e1-905b-0fb278c6fdae None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.834969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007d79-e695-44e1-905b-0fb278c6fdae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.835750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007d79-e695-44e1-905b-0fb278c6fdae None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:29.836233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007d79-e695-44e1-905b-0fb278c6fdae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.837791 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007d79-e695-44e1-905b-0fb278c6fdae None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.844316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 190/379] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:29 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:29.881145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5e790-8a36-4001-9a18-23686ba83a5a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:29.913813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:29.920329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d5bbe-8fd1-414e-944d-ae901886170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:29.921267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5bbe-8fd1-414e-944d-ae901886170f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:29.921679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5bbe-8fd1-414e-944d-ae901886170f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:29.922109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5bbe-8fd1-414e-944d-ae901886170f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:29.922964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d5bbe-8fd1-414e-944d-ae901886170f None admin] RBAC: Adding query filter params (group.id=cba8ec5915a4443591aae51f81cb9ccf, role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=b003f3768dcc465bb9a5bba73f3a6b18) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:29.923402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d5bbe-8fd1-414e-944d-ae901886170f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:29.924987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d5bbe-8fd1-414e-944d-ae901886170f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:29.931273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 190/380] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:29 2022] GET /identity/v3/role_assignments?group.id=cba8ec5915a4443591aae51f81cb9ccf&scope.project.id=b003f3768dcc465bb9a5bba73f3a6b18&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:30.235427 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870c26-c227-48be-950d-470a50356e70 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:30.235747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870c26-c227-48be-950d-470a50356e70 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:30.235988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870c26-c227-48be-950d-470a50356e70 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:30.237963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 191/381] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:30.244523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d36b9-bfb1-4b9d-9d82-4d2611d88d53 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:30.244815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d36b9-bfb1-4b9d-9d82-4d2611d88d53 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:30.245114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d36b9-bfb1-4b9d-9d82-4d2611d88d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:30.271259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ba6d36b9-bfb1-4b9d-9d82-4d2611d88d53 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:30.272455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ba6d36b9-bfb1-4b9d-9d82-4d2611d88d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:30.369959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 191/382] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:30.841089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870c26-c227-48be-950d-470a50356e70 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:30.860738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:30.961018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870c26-c227-48be-950d-470a50356e70 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:31.004677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:31.005348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.005630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.005895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.020408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:31.025784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:31.027385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:31.028954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 192/383] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:31.039356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d36b9-bfb1-4b9d-9d82-4d2611d88d53 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:31.170202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d36b9-bfb1-4b9d-9d82-4d2611d88d53 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:31.208356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:31.218480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:31.219106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.219374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.219679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.220309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:31.220610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:31.222065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:31.232089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 192/384] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:31.240404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:31.327744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:31.358272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa23f83-4606-4d36-b8eb-c7c6c897763b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:31.400454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:31.401115 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.401393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.401661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.402787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:31.404224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:31.406122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 193/385] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:31 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:31.414188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:31.527037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be696a7-d449-4fee-bb39-1b36c0deea90 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:31.567109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095d02c-0014-4d26-ad7d-ebbb37cb6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:31.567741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d02c-0014-4d26-ad7d-ebbb37cb6489 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.568023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d02c-0014-4d26-ad7d-ebbb37cb6489 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.568296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095d02c-0014-4d26-ad7d-ebbb37cb6489 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.569446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095d02c-0014-4d26-ad7d-ebbb37cb6489 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:31.571150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095d02c-0014-4d26-ad7d-ebbb37cb6489 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:31.572797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 193/386] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:31 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:31.578563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:31.598531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667fbf3-f258-4da4-84eb-796ee98e0ea4 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.598902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667fbf3-f258-4da4-84eb-796ee98e0ea4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.599049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667fbf3-f258-4da4-84eb-796ee98e0ea4 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.600397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 194/387] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:31.611183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90516e-5447-4a72-9900-f41ec6331ef2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.611933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90516e-5447-4a72-9900-f41ec6331ef2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.612206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90516e-5447-4a72-9900-f41ec6331ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.634780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ab90516e-5447-4a72-9900-f41ec6331ef2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:31.636604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ab90516e-5447-4a72-9900-f41ec6331ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:31.731521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:31.755588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 195/388] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:31.772446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5845e3-5f35-43e3-a85a-39274e1bda2b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:31.831572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393500ad-010e-46a6-bdc1-bd34c7aabf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:31.832605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393500ad-010e-46a6-bdc1-bd34c7aabf8d None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.833108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393500ad-010e-46a6-bdc1-bd34c7aabf8d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.833582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393500ad-010e-46a6-bdc1-bd34c7aabf8d None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce/groups/660a52e14ae0452c87d44c437a56307d/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.838846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393500ad-010e-46a6-bdc1-bd34c7aabf8d None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe42e1edb77415999b8e4fed6094dce, group_id=660a52e14ae0452c87d44c437a56307d, role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:31.841547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393500ad-010e-46a6-bdc1-bd34c7aabf8d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:31.862297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 194/389] 10.222.0.13 () {58 vars in 1442 bytes} [Sat Sep 3 03:36:31 2022] PUT /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce/groups/660a52e14ae0452c87d44c437a56307d/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:31.903266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8e31-40fa-47e9-ba49-d862537979b2 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.903633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8e31-40fa-47e9-ba49-d862537979b2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.903814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8e31-40fa-47e9-ba49-d862537979b2 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.905204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 196/390] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:31.922354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307887-b693-482b-9c0d-1bdf81af8ece None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:31.922681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307887-b693-482b-9c0d-1bdf81af8ece None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:31.922913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307887-b693-482b-9c0d-1bdf81af8ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:31.939051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:31.955407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b6307887-b693-482b-9c0d-1bdf81af8ece None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:31.956619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b6307887-b693-482b-9c0d-1bdf81af8ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:32.051246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 195/391] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:32.150994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8e31-40fa-47e9-ba49-d862537979b2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:32.155267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79973743-2600-4e77-bfe3-3688b204ce12 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.155556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79973743-2600-4e77-bfe3-3688b204ce12 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.155834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79973743-2600-4e77-bfe3-3688b204ce12 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.160031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 196/392] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:32.169215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df072-35d9-4199-9c6d-4068eae570c0 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.169501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df072-35d9-4199-9c6d-4068eae570c0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.169778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03df072-35d9-4199-9c6d-4068eae570c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.204370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d03df072-35d9-4199-9c6d-4068eae570c0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:32.207285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d03df072-35d9-4199-9c6d-4068eae570c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:32.330385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 197/393] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:32.330714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8e31-40fa-47e9-ba49-d862537979b2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:32.334748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df072-35d9-4199-9c6d-4068eae570c0 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:32.391476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:32.392108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.392382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.392650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.415182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:32.422064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:32.423002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:32.423832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 197/394] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:32.430804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:32.458017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:32.500443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:32.559522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32a4bb-4298-4994-933e-d1dc32dd5202 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:32.563032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03df072-35d9-4199-9c6d-4068eae570c0 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:32.597923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:32.598583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.598863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.599131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.599796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] RBAC: Adding query filter params (name=member) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:32.600093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:32.601857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:32.611084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 198/395] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:32.617219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:32.651455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:32.652101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.652388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.652663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.663646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:32.669082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:32.669978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:32.670754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 198/396] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:32.671464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:32.740627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1efa69-58de-421e-bfb6-2ea54eb138ad None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:32.756739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:32.795231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:32.796635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.797155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.797899 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.798528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3fa61-0757-4625-aba9-2da2b122b6a8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:32.799770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:32.804156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:32.811711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 199/397] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:32 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:32.811711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:32.839807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:32.840432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.840722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.841064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.847370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:32.852884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:32.857948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:32.858815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:32.859639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:32.860270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 199/398] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:32.860812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:32.945172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a0ca1-d4a3-43a1-a795-cd82ce8e3590 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:32.970730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0941af6-3d98-4551-93b0-527219f149df None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:32.988934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:32.990085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:32.990534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:32.990946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:32.991750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] RBAC: Adding query filter params (name=member) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:32.992344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:32.994468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.005911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 200/399] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:33.010840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.012516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.013330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.013936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.014188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.015948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.017124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.024043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 200/400] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:32 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:33.024043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.060588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:33.080597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:33.127888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890034e1-9a11-4a83-9dfb-081c36b25bfa None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.134422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83b745-b5d7-4f71-8174-e7a03e01ece3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.170870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad48676-e423-47e4-af5e-ef91331dcf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.171499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad48676-e423-47e4-af5e-ef91331dcf96 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.171768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad48676-e423-47e4-af5e-ef91331dcf96 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.172043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad48676-e423-47e4-af5e-ef91331dcf96 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.172718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad48676-e423-47e4-af5e-ef91331dcf96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:33.173053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad48676-e423-47e4-af5e-ef91331dcf96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.174447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad48676-e423-47e4-af5e-ef91331dcf96 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.177010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.177523 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.177799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.178065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.179275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.181172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.187387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 201/401] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:33 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:33.187387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.188120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 201/402] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:33.189430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51964adb-fb4b-499f-be37-4e0d77acc60f None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.189736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51964adb-fb4b-499f-be37-4e0d77acc60f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.190002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51964adb-fb4b-499f-be37-4e0d77acc60f None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.191367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 202/403] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:33.196081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51964adb-fb4b-499f-be37-4e0d77acc60f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.294401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945028-7640-4bd2-868a-a561efa64dcf None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.302199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:33.307846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51964adb-fb4b-499f-be37-4e0d77acc60f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.314566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:33.333592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa510ff-c447-428d-83b6-bce013ab0a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.334355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa510ff-c447-428d-83b6-bce013ab0a58 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.334702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa510ff-c447-428d-83b6-bce013ab0a58 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.335040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa510ff-c447-428d-83b6-bce013ab0a58 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/groups/660a52e14ae0452c87d44c437a56307d/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.337319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa510ff-c447-428d-83b6-bce013ab0a58 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5043e6fefe94a71a4b23176e17ce96b, group_id=660a52e14ae0452c87d44c437a56307d, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.338842 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa510ff-c447-428d-83b6-bce013ab0a58 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.346180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.346921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.347172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.347519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.348649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.350115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.361274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 203/404] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:33 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:33.361753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 202/405] 10.222.0.13 () {58 vars in 1442 bytes} [Sat Sep 3 03:36:33 2022] PUT /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/groups/660a52e14ae0452c87d44c437a56307d/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:33.361860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.361931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88c03-539b-4679-b64d-d402288317ce None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.361931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88c03-539b-4679-b64d-d402288317ce None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.361931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88c03-539b-4679-b64d-d402288317ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.383733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-93a88c03-539b-4679-b64d-d402288317ce None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:33.385414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-93a88c03-539b-4679-b64d-d402288317ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:33.478014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9e965-3d5b-4ce2-9817-e9855485b757 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.493006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 203/406] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:33.497956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88c03-539b-4679-b64d-d402288317ce None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.532563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.533447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.533831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.534332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.535687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.537274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.539566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 204/407] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:33 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:33.545143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.591382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:33.627409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88c03-539b-4679-b64d-d402288317ce None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.642056 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:33.677844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b70a62-444a-4b3a-9ebd-9f97db744a56 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.682038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.682977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.683460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.683934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce/groups/660a52e14ae0452c87d44c437a56307d/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.693821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] RBAC: Authorizing `identity:create_grant(project_id=1fe42e1edb77415999b8e4fed6094dce, group_id=660a52e14ae0452c87d44c437a56307d, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.695824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.721574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 204/408] 10.222.0.13 () {58 vars in 1442 bytes} [Sat Sep 3 03:36:33 2022] PUT /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce/groups/660a52e14ae0452c87d44c437a56307d/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:33.736753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.737859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.738371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.738842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.740589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.742519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.749045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 205/409] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:33 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:33.751186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.805934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:33.907556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57045da-233f-4058-9d94-bbeec381ec5a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.940978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c799a-6aee-4c4d-ae91-0e830d144a35 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:33.945512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:33.968365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b7965-13a6-4b08-a5ed-2c7a3e8876d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.969463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b7965-13a6-4b08-a5ed-2c7a3e8876d8 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.969964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b7965-13a6-4b08-a5ed-2c7a3e8876d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.970967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b7965-13a6-4b08-a5ed-2c7a3e8876d8 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/groups/660a52e14ae0452c87d44c437a56307d/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:33.974378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b7965-13a6-4b08-a5ed-2c7a3e8876d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5043e6fefe94a71a4b23176e17ce96b, group_id=660a52e14ae0452c87d44c437a56307d, role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:33.976659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b7965-13a6-4b08-a5ed-2c7a3e8876d8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:33.990789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:33.991568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:33.991785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:33.992062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.001016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 205/410] 10.222.0.13 () {58 vars in 1442 bytes} [Sat Sep 3 03:36:33 2022] PUT /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b/groups/660a52e14ae0452c87d44c437a56307d/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:34.008890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e6a60-bfbd-4ba3-bb0d-dbdda9c5fc48 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:34.009263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e6a60-bfbd-4ba3-bb0d-dbdda9c5fc48 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:34.009489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e6a60-bfbd-4ba3-bb0d-dbdda9c5fc48 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.009765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:34.015718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 206/411] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:34.016529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:34.017418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:34.018259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:34.018862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba157f-6c1c-47d9-ac9b-a93e0b297502 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:34.018862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba157f-6c1c-47d9-ac9b-a93e0b297502 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:34.018862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba157f-6c1c-47d9-ac9b-a93e0b297502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.021548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 206/412] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:34.031356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:34.041953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-77ba157f-6c1c-47d9-ac9b-a93e0b297502 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:34.043201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-77ba157f-6c1c-47d9-ac9b-a93e0b297502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:34.088943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:34.118337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 207/413] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:34.208500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0123b2-a5cf-448e-8393-ad2a624cc286 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:34.246553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:34.247171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:34.247511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:34.247786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.248513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:34.248820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:34.250260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:34.259609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 207/414] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:34.265126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba157f-6c1c-47d9-ac9b-a93e0b297502 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:34.400756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba157f-6c1c-47d9-ac9b-a93e0b297502 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:34.437297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:34.437855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:34.438137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:34.438409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] PATH_INFO: `/v3/groups/cba8ec5915a4443591aae51f81cb9ccf` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.439517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] RBAC: Authorizing `identity:get_group(group_id=cba8ec5915a4443591aae51f81cb9ccf)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:34.441098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:34.442840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 208/415] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:34 2022] GET /identity/v3/groups/cba8ec5915a4443591aae51f81cb9ccf => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:34.448454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:34.480820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:34.499893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:34.540374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:34.588900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38efb3-6bf8-4b20-94cb-8566635dcefa None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:34.626702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:34.627390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:34.627677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:34.627949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] PATH_INFO: `/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.629232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] RBAC: Authorizing `identity:get_project(project_id=b003f3768dcc465bb9a5bba73f3a6b18)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:34.630824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:34.632883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 208/416] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:34 2022] GET /identity/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:34.639671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:34.730954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b538-ade0-465f-ab9f-8138c00c05a2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:34.747709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:34.754071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae51fa-5ff6-490c-9e82-27c0c3df9072 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:34.810246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee076-459f-498e-8549-84b62557a117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:34.810887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee076-459f-498e-8549-84b62557a117 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:34.811163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee076-459f-498e-8549-84b62557a117 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:34.811429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee076-459f-498e-8549-84b62557a117 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.825465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:34.826135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:34.826414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:34.826688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] PATH_INFO: `/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18/groups/cba8ec5915a4443591aae51f81cb9ccf/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:34.828587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eee076-459f-498e-8549-84b62557a117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-41eee076-459f-498e-8549-84b62557a117 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:34.833446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:34.834326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:34.835088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 209/417] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:34.835742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] RBAC: Authorizing `identity:create_grant(project_id=b003f3768dcc465bb9a5bba73f3a6b18, group_id=cba8ec5915a4443591aae51f81cb9ccf, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:34.836906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:34.850163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee076-459f-498e-8549-84b62557a117 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:34.852434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 209/418] 10.222.0.13 () {58 vars in 1442 bytes} [Sat Sep 3 03:36:34 2022] PUT /identity/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18/groups/cba8ec5915a4443591aae51f81cb9ccf/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:34.958792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:34.974632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee076-459f-498e-8549-84b62557a117 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:35.011494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:35.012025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:35.012303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:35.012575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:35.013278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:35.013579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:35.014987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:35.028496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 210/419] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:35.034239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:35.168072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ed765-11d7-4c6d-96e8-e6a0dd424671 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:35.198833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:35.199455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:35.199739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:35.200016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:35.235816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:35.301275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:35.302673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:35.413389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 210/420] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:35.419535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:35.564795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089258a-d6eb-444d-893e-1a160239f64e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:35.609907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a10ec5-439f-4e8d-9a27-30191c379559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:35.610553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10ec5-439f-4e8d-9a27-30191c379559 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:35.610835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10ec5-439f-4e8d-9a27-30191c379559 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:35.611108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a10ec5-439f-4e8d-9a27-30191c379559 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:35.617640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10ec5-439f-4e8d-9a27-30191c379559 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:35.619118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a10ec5-439f-4e8d-9a27-30191c379559 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:35.621164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 211/421] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:35 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:35.626530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:35.719083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:35.773410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4dd00-5c48-40f4-8a08-84abd75b0dcd None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:35.783793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606dda-c6c4-4017-a8f8-3c0e0f875cca None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:35.784417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606dda-c6c4-4017-a8f8-3c0e0f875cca None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:35.784978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d606dda-c6c4-4017-a8f8-3c0e0f875cca None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:35.786803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 212/422] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:35.792437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549ef6-97d0-420c-af4a-f38f3d82298e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:35.793028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549ef6-97d0-420c-af4a-f38f3d82298e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:35.793522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549ef6-97d0-420c-af4a-f38f3d82298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:35.809165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:35.809925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:35.810206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:35.810475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:35.811586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:35.813052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:35.814971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 211/423] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:35 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:35.821477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8e549ef6-97d0-420c-af4a-f38f3d82298e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:35.821609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:35.823012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8e549ef6-97d0-420c-af4a-f38f3d82298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:35.836384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:35.948538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 213/424] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:35.957708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11025a-a4a8-4242-916b-f9776bc9c84b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:35.981461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:35.999413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:36.000024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.000302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.000571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.001325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=1fe42e1edb77415999b8e4fed6094dce) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:36.001633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:36.003074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:36.009692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 212/425] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:35 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:36.234459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32058-beca-4c01-879b-2131979da6d0 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.234977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32058-beca-4c01-879b-2131979da6d0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.234977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32058-beca-4c01-879b-2131979da6d0 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.237145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 214/426] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:36.238335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:36.242423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672364-982a-4a38-b9e5-cb1cb54ca9a4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.242704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672364-982a-4a38-b9e5-cb1cb54ca9a4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.242971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60672364-982a-4a38-b9e5-cb1cb54ca9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.270892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-60672364-982a-4a38-b9e5-cb1cb54ca9a4 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:36.272877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-60672364-982a-4a38-b9e5-cb1cb54ca9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:36.379505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 215/427] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:36.386498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4360c-8784-417d-9041-c79b4f615fc3 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:36.421029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9130-3cea-4791-90e9-e66d8ca42699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:36.421584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9130-3cea-4791-90e9-e66d8ca42699 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.421863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9130-3cea-4791-90e9-e66d8ca42699 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.422133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9130-3cea-4791-90e9-e66d8ca42699 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.436567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a9130-3cea-4791-90e9-e66d8ca42699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-353a9130-3cea-4791-90e9-e66d8ca42699 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:36.443921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:36.444879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:36.446406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 213/428] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:36.451116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672364-982a-4a38-b9e5-cb1cb54ca9a4 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:36.471759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0df6-414c-4c8c-8361-35b05040d237 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.472363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0df6-414c-4c8c-8361-35b05040d237 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.472813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0df6-414c-4c8c-8361-35b05040d237 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.475560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 214/429] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:36.479819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de655-56fd-43b3-a2b0-bb5b5f45a944 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.480297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de655-56fd-43b3-a2b0-bb5b5f45a944 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.480746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4de655-56fd-43b3-a2b0-bb5b5f45a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.501951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5b4de655-56fd-43b3-a2b0-bb5b5f45a944 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:36.503818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5b4de655-56fd-43b3-a2b0-bb5b5f45a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:36.532082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:36.554023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:36.556798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60672364-982a-4a38-b9e5-cb1cb54ca9a4 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:36.582937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 215/430] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:36.599659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:36.600480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.600934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.601629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.602541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:36.602991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:36.604500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:36.613944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 216/431] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:36.619882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4de655-56fd-43b3-a2b0-bb5b5f45a944 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:36.662949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:36.734253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4de655-56fd-43b3-a2b0-bb5b5f45a944 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:36.782776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ca2ea-f271-4d47-9790-39c191faba32 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:36.786042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:36.786819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.787230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.787645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.824867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:36.825678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:36.825960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:36.826282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:36.834367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:36.848938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:36.849936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 03:36:36.850838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:36.851635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:36.853281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 217/432] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:36.854166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:36.876332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:36.877857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:36.957196 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab142b-4744-4f18-879a-aa4a86e65526 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:36.983625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 216/433] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:36.984422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.002137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.003113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.003578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.004029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.004891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] RBAC: Adding query filter params (name=member) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:37.005387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.007254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.016096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 218/434] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:37.017126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.071802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.082632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.098443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7909ac0-792e-4366-ba14-75cb66a570b0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.125571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe5b08-20b8-44d7-b85e-de3c836fd7bf None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.133235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.133883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.134167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.134449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.144666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:37.149775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:37.150678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:37.151456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 217/435] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:37.152115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.174162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.174809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.175089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.175366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.176755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.178131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.180508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 219/436] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:37.185692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.262724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8231a07-e9dd-4266-98fe-8cfcb3dfe3f1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.290892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf357ac-b745-412d-9f8f-113999801081 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.299403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e03292-bc18-4a14-90d9-f107c3a3d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.300015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03292-bc18-4a14-90d9-f107c3a3d678 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.300296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03292-bc18-4a14-90d9-f107c3a3d678 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.300780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03292-bc18-4a14-90d9-f107c3a3d678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.304086 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.321672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.330218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.330832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.331112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.331390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.332062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:37.332367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.333778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.342293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 220/437] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:37.343087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.375973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e03292-bc18-4a14-90d9-f107c3a3d678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.377521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e03292-bc18-4a14-90d9-f107c3a3d678 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.443356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc452078-1ace-4da6-a914-02773ef79be2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.474873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 218/438] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:37.476109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93f209-d341-4066-b4d9-151c7bfcfa6a None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.476416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93f209-d341-4066-b4d9-151c7bfcfa6a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.476685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93f209-d341-4066-b4d9-151c7bfcfa6a None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.477952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 219/439] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:37.478637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93f209-d341-4066-b4d9-151c7bfcfa6a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.480654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.481330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.481608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.481875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.483261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.484724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.491373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 221/440] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:37.491373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.525495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.546150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.588415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234c8c-6781-4dcc-9389-979996a33824 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.591801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93f209-d341-4066-b4d9-151c7bfcfa6a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.622691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9886ff-1a51-42da-9140-fa17ca942947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.623310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9886ff-1a51-42da-9140-fa17ca942947 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.623589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9886ff-1a51-42da-9140-fa17ca942947 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.623855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9886ff-1a51-42da-9140-fa17ca942947 None admin] PATH_INFO: `/v3/projects/1fe42e1edb77415999b8e4fed6094dce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.624974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9886ff-1a51-42da-9140-fa17ca942947 None admin] RBAC: Authorizing `identity:get_project(project_id=1fe42e1edb77415999b8e4fed6094dce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.625986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.626421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9886ff-1a51-42da-9140-fa17ca942947 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.626589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.626869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.627147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.628029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 222/441] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/projects/1fe42e1edb77415999b8e4fed6094dce => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:37.629133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cac4e6-b523-47fb-9d7e-b4ddbd5aa045 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.629412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cac4e6-b523-47fb-9d7e-b4ddbd5aa045 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.629681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cac4e6-b523-47fb-9d7e-b4ddbd5aa045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.646980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-90cac4e6-b523-47fb-9d7e-b4ddbd5aa045 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:37.648144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-90cac4e6-b523-47fb-9d7e-b4ddbd5aa045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:37.697902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.699359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.713266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 223/442] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:37.715059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cac4e6-b523-47fb-9d7e-b4ddbd5aa045 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.735003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.774822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:37.805329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 220/443] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:37.806126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.825601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cac4e6-b523-47fb-9d7e-b4ddbd5aa045 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.860427 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.861058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.861641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.861913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.862630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:37.862952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.864375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.870971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 224/444] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=ad683698d38f4826b4af8e1069955c8e => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:37.871936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:37.934066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7a98-8f41-468c-a797-ffa48713cdd7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.983398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a56d2-7756-47a7-b388-2935cc33df56 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:37.983743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:37.984394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:37.984671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:37.985123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:37.986642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:37.988109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:37.989958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 221/445] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:37.991225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.002729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:38.007390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:38.022982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.023627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.024057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.024434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] PATH_INFO: `/v3/projects/a5043e6fefe94a71a4b23176e17ce96b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.025607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] RBAC: Authorizing `identity:get_project(project_id=a5043e6fefe94a71a4b23176e17ce96b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:38.027060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:38.033052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 225/446] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/projects/a5043e6fefe94a71a4b23176e17ce96b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:38.033052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.102739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcefe8-56a8-40fb-9b0c-52d38d2cb929 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:38.137709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.138333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.138606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.138872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.142533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cae4e-585f-4f34-b5a4-405898dfb9ee None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:38.149076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:38.154196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:38.155062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:38.155857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 222/447] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:38.156496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.179414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.180054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.180363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.180628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.181360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=ad683698d38f4826b4af8e1069955c8e, scope.project.id=1fe42e1edb77415999b8e4fed6094dce) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:38.181666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:38.183102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:38.188655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 226/448] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:38 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=1fe42e1edb77415999b8e4fed6094dce&role.id=ad683698d38f4826b4af8e1069955c8e => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:38.189453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.234358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:38.251821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:38.280666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3abd81-2f5f-4884-a744-0fe236caed1d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:38.306002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13cf228-56da-4422-8cb2-1c269c705ae5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:38.319599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.320419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.320761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.321288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] PATH_INFO: `/v3/groups/660a52e14ae0452c87d44c437a56307d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.322538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] RBAC: Authorizing `identity:get_group(group_id=660a52e14ae0452c87d44c437a56307d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:38.323987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:38.330466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 223/449] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:38 2022] GET /identity/v3/groups/660a52e14ae0452c87d44c437a56307d => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:38.331944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.345000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.345738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.346020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.346288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.347097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:38.347236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:38.348602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:38.359013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 227/450] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:38.364552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.452209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b2be1-f718-4a3b-a057-fbbc90d59385 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:38.485796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:38.493635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fecd4-022e-4201-8791-c3a8b46fe520 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:38.493801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.494284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.494570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.494844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.495576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] RBAC: Adding query filter params (group.id=660a52e14ae0452c87d44c437a56307d, role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=a5043e6fefe94a71a4b23176e17ce96b) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:38.495887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:38.497373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:38.505119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 224/451] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:38 2022] GET /identity/v3/role_assignments?group.id=660a52e14ae0452c87d44c437a56307d&scope.project.id=a5043e6fefe94a71a4b23176e17ce96b&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:38.517006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:38.543226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.543853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.544138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.544411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.632189 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:38.634566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:38.742187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 228/452] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:38.748164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.852798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643ae8-401b-4c83-bc57-a46f92e297a8 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:38.886793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:38.887427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:38.887706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:38.887974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] PATH_INFO: `/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:38.889097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b003f3768dcc465bb9a5bba73f3a6b18)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:38.890545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:38.892163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 225/453] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:36:38 2022] GET /identity/v3/projects/b003f3768dcc465bb9a5bba73f3a6b18 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:38.898011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:38.913350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:39.000421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9613-68b4-463d-b83b-12cba9bdc5c2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:39.034966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946c2b3-afa0-4a4e-a5da-56377d74b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:39.035593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946c2b3-afa0-4a4e-a5da-56377d74b070 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:39.035875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946c2b3-afa0-4a4e-a5da-56377d74b070 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:39.036145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946c2b3-afa0-4a4e-a5da-56377d74b070 None admin] PATH_INFO: `/v3/groups/cba8ec5915a4443591aae51f81cb9ccf` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:39.037275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946c2b3-afa0-4a4e-a5da-56377d74b070 None admin] RBAC: Authorizing `identity:get_group(group_id=cba8ec5915a4443591aae51f81cb9ccf)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:39.038734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946c2b3-afa0-4a4e-a5da-56377d74b070 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:39.040839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 229/454] 10.222.0.13 () {56 vars in 1180 bytes} [Sat Sep 3 03:36:38 2022] GET /identity/v3/groups/cba8ec5915a4443591aae51f81cb9ccf => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:39.047472 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:39.126833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:39.168653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ed771-f82b-432d-b458-af42b704e6a1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:39.208325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c65b94-2ee1-4f7b-a78c-cca82bb5aa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:39.208956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c65b94-2ee1-4f7b-a78c-cca82bb5aa2f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:39.209237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c65b94-2ee1-4f7b-a78c-cca82bb5aa2f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:39.209512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c65b94-2ee1-4f7b-a78c-cca82bb5aa2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:39.210239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c65b94-2ee1-4f7b-a78c-cca82bb5aa2f None admin] RBAC: Adding query filter params (group.id=cba8ec5915a4443591aae51f81cb9ccf, role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=b003f3768dcc465bb9a5bba73f3a6b18) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:39.210546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c65b94-2ee1-4f7b-a78c-cca82bb5aa2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:39.212068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c65b94-2ee1-4f7b-a78c-cca82bb5aa2f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:39.217779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 226/455] 10.222.0.13 () {56 vars in 1376 bytes} [Sat Sep 3 03:36:39 2022] GET /identity/v3/role_assignments?group.id=cba8ec5915a4443591aae51f81cb9ccf&scope.project.id=b003f3768dcc465bb9a5bba73f3a6b18&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:41.594064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34a30-f6ce-4c6c-87f9-d45fd9625e60 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:41.594064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34a30-f6ce-4c6c-87f9-d45fd9625e60 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:41.594064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34a30-f6ce-4c6c-87f9-d45fd9625e60 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:41.595142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 230/456] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:41.600907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abbd41-d8fc-452f-9602-3e56f52955a3 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:41.601378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abbd41-d8fc-452f-9602-3e56f52955a3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:41.601576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abbd41-d8fc-452f-9602-3e56f52955a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:41.625402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-68abbd41-d8fc-452f-9602-3e56f52955a3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:41.626611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-68abbd41-d8fc-452f-9602-3e56f52955a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:41.726821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 227/457] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:42.087766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a34a30-f6ce-4c6c-87f9-d45fd9625e60 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:42.179251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a334-f060-4139-a535-e86ea1bcf3a2 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.180314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a334-f060-4139-a535-e86ea1bcf3a2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.180953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2a334-f060-4139-a535-e86ea1bcf3a2 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.183483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 228/458] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:42.189240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600df4-0116-4c1f-87cd-c21787acb748 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.190085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600df4-0116-4c1f-87cd-c21787acb748 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.190556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600df4-0116-4c1f-87cd-c21787acb748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.200531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:42.218128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a34a30-f6ce-4c6c-87f9-d45fd9625e60 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:42.218332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ba600df4-0116-4c1f-87cd-c21787acb748 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:42.219764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ba600df4-0116-4c1f-87cd-c21787acb748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:42.259136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:42.260213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.261463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.261900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.275410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:42.276869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:42.292687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:42.293662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:42.294509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:42.294509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:42.294509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:42.296519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 229/460] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:42.296850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:42.298126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 231/460] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:42.305665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:42.306253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304d8c6-29a1-4895-b808-54d93ac1a887 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.306950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304d8c6-29a1-4895-b808-54d93ac1a887 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.316964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304d8c6-29a1-4895-b808-54d93ac1a887 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.316964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 230/461] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:42.323879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5251692-aed8-40b1-850d-ac0756c956d7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.324165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5251692-aed8-40b1-850d-ac0756c956d7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.324435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5251692-aed8-40b1-850d-ac0756c956d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.352540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c5251692-aed8-40b1-850d-ac0756c956d7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:42.353681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c5251692-aed8-40b1-850d-ac0756c956d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:42.452272 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 231/462] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:42.498212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f03e3d-f3ac-4ba7-b1db-9e745a8d71c8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:42.552269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:42.552879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.553182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.553451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.554088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:42.554383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:42.556173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:42.558089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:42.563153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5251692-aed8-40b1-850d-ac0756c956d7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:42.600598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 232/463] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:42.608837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:42.693319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5251692-aed8-40b1-850d-ac0756c956d7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:42.714183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:42.734090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f77de-9051-4ab5-88fa-a6f990087227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:42.734993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f77de-9051-4ab5-88fa-a6f990087227 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.735423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f77de-9051-4ab5-88fa-a6f990087227 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.735830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f77de-9051-4ab5-88fa-a6f990087227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.751584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f77de-9051-4ab5-88fa-a6f990087227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:42.753642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f77de-9051-4ab5-88fa-a6f990087227 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:42.758581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81658db7-98c6-4700-9ae0-d97af398806d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-784f77de-9051-4ab5-88fa-a6f990087227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:42.771540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:42.772455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:42.773368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:42.773368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:42.773368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:42.779211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 232/464] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:42.779211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c216cd-a283-4935-83da-aaa3d2f23204 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.779211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c216cd-a283-4935-83da-aaa3d2f23204 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.779211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c216cd-a283-4935-83da-aaa3d2f23204 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.779211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 233/465] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:42.779211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c216cd-a283-4935-83da-aaa3d2f23204 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:42.800113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:42.800731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.801040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.801317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.801962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:42.803858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:42.836954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 233/466] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:42 2022] POST /identity/v3/users => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:42.836954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:42.901903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c216cd-a283-4935-83da-aaa3d2f23204 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:42.909682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:42.944045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75fea5-b67f-429e-ae01-f2142903a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:42.945519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75fea5-b67f-429e-ae01-f2142903a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.945882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75fea5-b67f-429e-ae01-f2142903a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.946158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75fea5-b67f-429e-ae01-f2142903a0f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:42.958729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75fea5-b67f-429e-ae01-f2142903a0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:42.960219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75fea5-b67f-429e-ae01-f2142903a0f0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:42.967949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9b393-0b2e-40aa-a277-5e204df79149 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-1c75fea5-b67f-429e-ae01-f2142903a0f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:42.976029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:42.978695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:42.979546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:42.979546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:42.979546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:42.979546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 234/467] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:42.979546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701a8e-f92f-4010-be92-ecaf85e86d2a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:42.979546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701a8e-f92f-4010-be92-ecaf85e86d2a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:42.979546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701a8e-f92f-4010-be92-ecaf85e86d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.000235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5a701a8e-f92f-4010-be92-ecaf85e86d2a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:43.001548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5a701a8e-f92f-4010-be92-ecaf85e86d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:43.012508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db5260-188a-4ebc-b196-572ad40c297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.013155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5260-188a-4ebc-b196-572ad40c297d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.013489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5260-188a-4ebc-b196-572ad40c297d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.013708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5260-188a-4ebc-b196-572ad40c297d None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.014354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db5260-188a-4ebc-b196-572ad40c297d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:43.014654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db5260-188a-4ebc-b196-572ad40c297d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.016044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db5260-188a-4ebc-b196-572ad40c297d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:43.019480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:43.029270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 234/468] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:43.030373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd780d0-f2e5-4936-8090-16edf76000a4 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.030656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd780d0-f2e5-4936-8090-16edf76000a4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.030931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd780d0-f2e5-4936-8090-16edf76000a4 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.032355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 235/469] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:43.033141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd780d0-f2e5-4936-8090-16edf76000a4 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.085867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 235/470] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:43.086954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701a8e-f92f-4010-be92-ecaf85e86d2a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.175667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd780d0-f2e5-4936-8090-16edf76000a4 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:43.187690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:43.214521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5e71-6293-4f50-bd1c-0bd3daef1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.215566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5e71-6293-4f50-bd1c-0bd3daef1366 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.216053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5e71-6293-4f50-bd1c-0bd3daef1366 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.216530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5e71-6293-4f50-bd1c-0bd3daef1366 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.217462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5e71-6293-4f50-bd1c-0bd3daef1366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:43.217977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5e71-6293-4f50-bd1c-0bd3daef1366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.219061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701a8e-f92f-4010-be92-ecaf85e86d2a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:43.219933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5e71-6293-4f50-bd1c-0bd3daef1366 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:43.232894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 236/471] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:43.234611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c621b5a-ce0d-40cf-bc48-51738197f264 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.235090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c621b5a-ce0d-40cf-bc48-51738197f264 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.235594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c621b5a-ce0d-40cf-bc48-51738197f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.254741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-9c621b5a-ce0d-40cf-bc48-51738197f264 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:43.256335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9c621b5a-ce0d-40cf-bc48-51738197f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:43.264083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.265112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.265397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.265670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.266310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.268086 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:43.295388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 236/472] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:43 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:43.297666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.325221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:43.360767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 237/473] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:43.365330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c621b5a-ce0d-40cf-bc48-51738197f264 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.499758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97512c-cf91-45e9-b8bd-564812bc6539 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:43.505096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:43.508699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c621b5a-ce0d-40cf-bc48-51738197f264 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:43.541513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.542549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.543013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.543514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.544383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.546161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:43.552265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.552905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.553214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.553486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.565009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.566483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:43.576816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 237/474] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:43 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:43.587204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:43.588615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:43.589492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:43.589492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:43.589492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:43.589492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 238/475] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:43.594485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.640360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.684643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:43.739263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a453c-09c5-4338-aa6e-7e36e2054265 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:43.770431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd897388-f086-414d-b724-113459e9bd72 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:43.781030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.781654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.781928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.782199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.782846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:43.783146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.784520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:43.798311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 238/476] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:43.806669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.809900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.810517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.810795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.811067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.811756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.813384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:43.823179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.sql.core [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 03 03:36:43.823179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 03 03:36:43.823179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [parameters: {'id': '9fbf351e4ce146b0837fb06d99bd07c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 03 03:36:43.823179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87938) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application conn.query(q) Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result.read() Sep 03 03:36:43.843881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return ref.to_dict() Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 03:36:43.844766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application next(self.gen) Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application yield resource Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application next(self.gen) Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise self.value Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application session.commit() Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 03:36:43.845688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.session.flush() Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application compat.raise_( Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 03:36:43.846519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 03:36:43.847380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application conn.query(q) Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result.read() Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 03:36:43.848178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [parameters: {'id': '9fbf351e4ce146b0837fb06d99bd07c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:43.848985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 03 03:36:43.849865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:43.850688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 239/477] 10.222.0.13 () {60 vars in 1131 bytes} [Sat Sep 3 03:36:43 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:43.853984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:43.887825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:43.931382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc69e2-311c-4175-a410-9a4ac957e2b1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:43.959090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:43.979662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:43.980277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:43.981656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:43.981931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:43.982586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:43.985156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:44.028264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 239/478] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:43 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:44.041489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6841072-e406-42ba-8bf9-9f2190ea5d8e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:44.085791 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eb81b-d3c9-454d-acec-ac11b41d542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:44.086429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb81b-d3c9-454d-acec-ac11b41d542e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:44.086793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb81b-d3c9-454d-acec-ac11b41d542e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:44.087069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eb81b-d3c9-454d-acec-ac11b41d542e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:44.102150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eb81b-d3c9-454d-acec-ac11b41d542e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-a88eb81b-d3c9-454d-acec-ac11b41d542e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:44.109424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:44.110311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:44.111868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 240/479] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:36:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:44.119318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:44.254619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275abc48-60cb-475e-8778-620ba7b8ef1d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:44.289592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6b520-8e55-4a28-8ceb-338a67dd22b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:44.290118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b520-8e55-4a28-8ceb-338a67dd22b6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:44.290395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b520-8e55-4a28-8ceb-338a67dd22b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:44.290664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b520-8e55-4a28-8ceb-338a67dd22b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:44.291324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6b520-8e55-4a28-8ceb-338a67dd22b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:44.291620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6b520-8e55-4a28-8ceb-338a67dd22b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:44.293080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6b520-8e55-4a28-8ceb-338a67dd22b6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:44.301930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 240/480] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:45.239892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5706cc-c50e-4e54-9e07-ee645d0ccd80 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:45.240678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5706cc-c50e-4e54-9e07-ee645d0ccd80 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:45.241391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5706cc-c50e-4e54-9e07-ee645d0ccd80 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:45.244672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 241/481] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:45.250301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4077ef-74a7-48b1-b016-d8938c0a1277 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:45.250771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4077ef-74a7-48b1-b016-d8938c0a1277 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:45.250848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4077ef-74a7-48b1-b016-d8938c0a1277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:45.270325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2b4077ef-74a7-48b1-b016-d8938c0a1277 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:45.271535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2b4077ef-74a7-48b1-b016-d8938c0a1277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:45.319457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:45.359803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 241/482] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:45.778188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5706cc-c50e-4e54-9e07-ee645d0ccd80 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:45.894940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:45.926592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5706cc-c50e-4e54-9e07-ee645d0ccd80 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:45.968522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7646aa-3656-413f-b607-2fff36d205ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:45.969192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7646aa-3656-413f-b607-2fff36d205ea None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:45.969475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7646aa-3656-413f-b607-2fff36d205ea None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:45.969751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7646aa-3656-413f-b607-2fff36d205ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:45.987946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7646aa-3656-413f-b607-2fff36d205ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-2d7646aa-3656-413f-b607-2fff36d205ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:45.993379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:45.994255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:45.995068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 242/483] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:46.000771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4077ef-74a7-48b1-b016-d8938c0a1277 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.104364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a3124-6cea-4217-b90a-d512c436290b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.104660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a3124-6cea-4217-b90a-d512c436290b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.104831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a3124-6cea-4217-b90a-d512c436290b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.107198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 243/484] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:46.114586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ff0b-afed-4209-a32e-c879703dc45c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.114586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ff0b-afed-4209-a32e-c879703dc45c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.114586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725ff0b-afed-4209-a32e-c879703dc45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.120046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4077ef-74a7-48b1-b016-d8938c0a1277 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:46.137072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8725ff0b-afed-4209-a32e-c879703dc45c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:46.138296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8725ff0b-afed-4209-a32e-c879703dc45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:46.177360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9944903-c865-4c71-9791-98ef69639d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:46.178263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9944903-c865-4c71-9791-98ef69639d15 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.178743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9944903-c865-4c71-9791-98ef69639d15 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.179196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9944903-c865-4c71-9791-98ef69639d15 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.180179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9944903-c865-4c71-9791-98ef69639d15 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:46.180652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9944903-c865-4c71-9791-98ef69639d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:46.182239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9944903-c865-4c71-9791-98ef69639d15 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:46.191603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 242/485] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:46.193255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be787e-8f4e-4a74-a4fa-47ce8413e721 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.193695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be787e-8f4e-4a74-a4fa-47ce8413e721 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.194121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be787e-8f4e-4a74-a4fa-47ce8413e721 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.195512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 243/486] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:46.200542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be787e-8f4e-4a74-a4fa-47ce8413e721 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.230601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 244/487] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:46.241334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd5761-28d2-4c4a-afd4-b59ec1da5684 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.241334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd5761-28d2-4c4a-afd4-b59ec1da5684 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.241334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd5761-28d2-4c4a-afd4-b59ec1da5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.248059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:46.266557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-85bd5761-28d2-4c4a-afd4-b59ec1da5684 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:46.267871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-85bd5761-28d2-4c4a-afd4-b59ec1da5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:46.331640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:46.340543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 245/488] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:46.382698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be787e-8f4e-4a74-a4fa-47ce8413e721 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:46.429993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:46.430626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.430902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.431173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.454006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:46.455466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:46.472924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:46.473828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:46.474721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:46.474721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:46.474721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:46.474721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 244/489] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:46.480263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd5761-28d2-4c4a-afd4-b59ec1da5684 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.566212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.638476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd5761-28d2-4c4a-afd4-b59ec1da5684 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:46.679866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:46.681249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.681570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.681843 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.682506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:46.682810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:46.684218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:46.687213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:46.701973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 246/490] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:46.703050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.706373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638de64-face-47cd-8239-2fb6b727ca5f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:46.753063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:46.753706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.753990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.754267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.766547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:46.771838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:46.774752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:46.775620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:46.776451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:46.777563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 245/491] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:46.777727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.827202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded28b0-0c2b-4c2e-b708-634747fbe2f4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:46.863624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed179479-3808-4be5-bda4-68989e6b1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:46.864294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179479-3808-4be5-bda4-68989e6b1f91 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.864566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179479-3808-4be5-bda4-68989e6b1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.864811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179479-3808-4be5-bda4-68989e6b1f91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.875521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed179479-3808-4be5-bda4-68989e6b1f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-ed179479-3808-4be5-bda4-68989e6b1f91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:46.881931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:46.882915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:46.883671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:46.888164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 247/492] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:46.888690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069a25a-31d3-4359-a723-e34ba864013a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:46.889902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b61b-d0b9-4961-970d-956c29be27f1 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.890194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b61b-d0b9-4961-970d-956c29be27f1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.890471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b61b-d0b9-4961-970d-956c29be27f1 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.891888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 248/493] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:46.892628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937b61b-d0b9-4961-970d-956c29be27f1 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.923134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:46.923855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:46.924136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:46.924401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:46.931829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:46.933288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:46.945560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:46.946506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 246/494] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:36:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:46.947374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:46.956949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:46.998219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937b61b-d0b9-4961-970d-956c29be27f1 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.013924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.032710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af171e8-05ab-42bb-898d-07f5a712536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.033352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af171e8-05ab-42bb-898d-07f5a712536c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.033628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af171e8-05ab-42bb-898d-07f5a712536c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.033897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af171e8-05ab-42bb-898d-07f5a712536c None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.034555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af171e8-05ab-42bb-898d-07f5a712536c None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:47.034854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af171e8-05ab-42bb-898d-07f5a712536c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.036232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af171e8-05ab-42bb-898d-07f5a712536c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.049222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 249/495] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:47.049222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07b2a-66ea-42e5-9300-ca0113fd29f7 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.049222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07b2a-66ea-42e5-9300-ca0113fd29f7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.049222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07b2a-66ea-42e5-9300-ca0113fd29f7 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.049222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 250/496] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:47.049599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1758e8-4092-49e7-8b23-b331d9f1526f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.049672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ecde5-c6fa-4031-8a7b-074a546c7684 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.049672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ecde5-c6fa-4031-8a7b-074a546c7684 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.049672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ecde5-c6fa-4031-8a7b-074a546c7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.066129 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-006ecde5-c6fa-4031-8a7b-074a546c7684 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:47.067321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-006ecde5-c6fa-4031-8a7b-074a546c7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:47.080778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.081408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.081707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.081961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.082609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:47.082909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.084281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.092151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 247/497] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:47.093048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.137887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 251/498] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:47.138825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ecde5-c6fa-4031-8a7b-074a546c7684 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.173735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.211150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cea50-c6a0-4392-9f40-bda400796775 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.248088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6a9a5-014c-4f19-afed-b92e479a41fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.248689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6a9a5-014c-4f19-afed-b92e479a41fc None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.248991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6a9a5-014c-4f19-afed-b92e479a41fc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.249263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6a9a5-014c-4f19-afed-b92e479a41fc None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.249987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6a9a5-014c-4f19-afed-b92e479a41fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:47.250290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6a9a5-014c-4f19-afed-b92e479a41fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.251705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6a9a5-014c-4f19-afed-b92e479a41fc None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.253367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ecde5-c6fa-4031-8a7b-074a546c7684 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.263418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.289707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 248/499] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:47.291176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c189-89b1-43d8-8ccf-d9c5e65806e7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.291464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c189-89b1-43d8-8ccf-d9c5e65806e7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.291738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c189-89b1-43d8-8ccf-d9c5e65806e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.295506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.296145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.296421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.296682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.308190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.309677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.309780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9ef1c189-89b1-43d8-8ccf-d9c5e65806e7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:47.310961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9ef1c189-89b1-43d8-8ccf-d9c5e65806e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:47.325281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:47.326183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:47.327004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:47.327004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:47.327004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:47.327004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 252/500] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:47.327241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.388199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 249/501] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:47.389149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c189-89b1-43d8-8ccf-d9c5e65806e7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.438668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7cd35-d5d6-406f-98f6-4c4390771cd8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.456371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.476676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.477450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.477735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.478014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.489062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.490769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:47.505498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:47.506394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:47.507240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:47.507240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:47.507240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:47.507418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c189-89b1-43d8-8ccf-d9c5e65806e7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.508854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 253/502] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:47.509794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.525776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.552361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.553025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.553310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.553585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.617120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc251fd-be3f-40b8-a523-01ba5c4dbb86 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.624655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.626243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.653431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.653958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.654243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.654512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.655149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:47.655447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.656820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.668562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 254/503] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:47.669392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.681540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.726788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 250/504] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:47.727890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.745881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.776572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e9bd7-6230-4675-a6cc-c51dccc7fca2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.811735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.812373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.812656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.812944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.822930 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.824396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.826620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70751c1b-8a56-466a-9d33-ba23e16b5f8e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:47.838978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:47.839882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:47.840714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:47.840714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:47.840714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:47.840714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 255/505] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:47.841226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.867236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.867860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.868134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.868405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.869080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:47.869386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:47.870758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:47.882378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 251/506] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:47.883239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:47.901182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.943938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa79f3-5468-4fef-b8b8-e55a8829f8fd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.966743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:47.979062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:47.979700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:47.979982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:47.980252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:47.981788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941b1e2-86cb-40e2-b74a-fe91a1574ee0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:47.991010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:47.996276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:47.997237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:47.998020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 256/507] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:47.998659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.020932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.021641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.021919 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.022190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.029772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.031226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:48.042323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:48.043250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 252/508] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:48.044105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.102188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b8a19-d65a-445a-be27-fa8eda9fa176 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.119514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.136380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.137040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.137316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.137581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.142235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf6fd-1988-469d-8dc8-8416ef0b127f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.147837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.149397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:48.163501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:48.164680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:48.165534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:48.165534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:48.165534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:48.165534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 257/509] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:48.166174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.183379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.184397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.184844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.185337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.186313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:48.186675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.188099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.201188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 253/510] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:48.201904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.211286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.278357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c63f0-02ca-466b-8595-7f23b718ebf4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.300721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cd33b-2dba-416b-95da-8f4ead433371 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.311191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.311817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.312092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.312360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] PATH_INFO: `/v3/users/glance` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.319983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.321507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:48.333985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:48.335059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 03:36:48.335946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:48.336566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.336659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 258/511] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:48.336732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.336732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.336732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.336949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.337024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:48.337024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.338468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.341461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.347951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 254/512] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:48.348740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.433286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.439892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e942b2-5b71-4455-a560-6395dbbc748d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.447317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d11d62-3b44-45e7-98a1-996bbbf16d05 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.472857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.473426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.473704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.473974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.474695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:48.474995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.476477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.484010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.485527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.485811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.486080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.487065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:48.487367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.488730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.503975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 255/513] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:48.509007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.515250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 259/514] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:48.516086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.574690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.618097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfeea72-45dd-42c4-a4d3-25d58d0e4aef None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.619438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890073b-a241-4ead-9c14-c3462d4e3cf0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.651656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.652262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.652359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.652547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.652822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.652961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.653241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.653508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.653601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:48.653875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.654135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.655331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.655546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.674094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 260/515] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:48.674975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.685773 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 256/516] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:36:48 2022] POST /identity/v3/users => generated 247 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:36:48.686913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.690029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.789908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc2dd-549e-4223-a53e-78e3d5dbcf3b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.818418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42a54a-b4d5-49e6-bd9d-c238d621200c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.833942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.844759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.845451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.845732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.846598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.857847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:48.858492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:48.858605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.858775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:48.859050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:48.860069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.867217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:48.868692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:48.877669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:48.878566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:48.879385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:48.879385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:48.879385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:48.879385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 261/517] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:48.879950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:48.884982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:48.885988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:48.887020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:48.888968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 257/518] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:48.889932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:48.951190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:48.992952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe820b-9068-40e0-836e-34e88f1014bd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:48.995140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e418626-1e82-42e6-8210-aef29bbd00b1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.028022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.028634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.028941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.029215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.029551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.030166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.030448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.030723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.079375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.101225 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.103043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.107589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.109084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.170655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.213773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 262/519] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:49.213773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.224525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 258/520] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:49.225317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.305859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.326630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f36ba2-018f-4823-91c0-e5e83c353b01 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.336383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4b96e-cc1c-48cb-9e06-4692bb3e724e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.363916 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.364520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.364797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.365099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.365766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:49.366058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.367543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.373396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.374227 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.374539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.374815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.375500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:49.375795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.377223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.379660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 263/521] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:49.384666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.396286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 259/522] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:49.397223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.417055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.494856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e399e9-0865-40e6-a965-b3e103792130 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.496394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302574-d15a-47eb-9343-ca8b14479588 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.529076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.529606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.529736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.529958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.530228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.530317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.530505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.530874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.532088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.542200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.543190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.543652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.544860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:49.558231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:49.559147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:49.559964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:49.559964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:49.559964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:49.560119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:49.561043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:49.561857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:49.561857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:49.561857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:49.562010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 260/523] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:49.562087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 264/524] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:49.562152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.562231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.650625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.671597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc78235-927c-4c0c-b476-e0507a610ae5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.675044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778a48d-de01-478e-86e2-51c75571dc51 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.707324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.707953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.708230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.708503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.713401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.714041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.714334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.714607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.715334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=b74a8d0579ba402c8f64fa7a6bb24658) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:49.715641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.717041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.717155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.718466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.733250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 265/525] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/role_assignments?user.id=b74a8d0579ba402c8f64fa7a6bb24658&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:49.733250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:49.733499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:49.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 03:36:49.735286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:49.736585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 261/526] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:49.737277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.790626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.852072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf0961-92a3-44f5-b257-c974168d5649 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.867387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be210d-7dd8-4997-bb62-6a3412fddb6c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:49.903988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.904530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.904818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.905152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.905807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:49.906130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.907497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.909294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:49.910216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:49.910714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:49.911166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:49.911986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:49.912471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:49.914127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:49.917063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:49.925412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 266/527] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:49.925412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:49.934882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 262/528] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:49.935994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.046163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfaa9e-92f9-471f-94c9-7c5c918f17c7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.055531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:50.060582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bf1a3-e315-4278-8e7f-0d1dbf577077 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.089077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.090303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.090792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.091260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.098868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.100706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.105697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.106310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.106628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.106859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.107598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:50.107906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.109656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:50.114810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:50.115620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:50.116463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:50.123524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 263/529] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:50.124699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.132633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 267/530] 10.222.0.13 () {56 vars in 1139 bytes} [Sat Sep 3 03:36:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:50.132633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.207698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:50.249636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd225de-1d89-44a9-93fc-2489cfce2863 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.254514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1afd9-566c-4d89-9362-cc6d03b24578 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.291084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.291604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.291748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.291952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.292224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.292347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.292530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.292806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.292899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:50.293231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.294953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.300432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.301930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.313548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 268/531] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:50.314509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:50.315051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:50.315855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:50.316696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 264/532] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:50.324583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.365295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:50.427692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e332feb-b01d-4293-965e-4900fff06107 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.431361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd4d15-8d52-4f01-9077-4d0caa578053 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.446452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:50.465874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3d412-305d-4fa6-a11c-3ebf0561391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.466048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.466498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.466782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.467056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.467542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3d412-305d-4fa6-a11c-3ebf0561391c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.467742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:50.468056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.468395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3d412-305d-4fa6-a11c-3ebf0561391c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.468841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3d412-305d-4fa6-a11c-3ebf0561391c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.469585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.488479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 265/533] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:50.489423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.543374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3d412-305d-4fa6-a11c-3ebf0561391c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.545351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3d412-305d-4fa6-a11c-3ebf0561391c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.576629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:50.593642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84906c41-1cfb-430b-af84-7edc4254cbe6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.629590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.630199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.630486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.630812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.631543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=21baacaa1f1c4342aacda4c967a6da58) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:50.631899 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.633631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.639723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 266/534] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/role_assignments?user.id=21baacaa1f1c4342aacda4c967a6da58&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:50.640669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.663037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 269/535] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:36:50.669774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e2e9-115d-433c-aa34-7e47e89a2e11 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.670338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e2e9-115d-433c-aa34-7e47e89a2e11 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.670796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7e2e9-115d-433c-aa34-7e47e89a2e11 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.672862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 270/536] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:50.673904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7e2e9-115d-433c-aa34-7e47e89a2e11 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.697887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:50.763624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bde6b4-db06-4e1c-88f7-e667e071da97 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.808293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8061e5-0bb3-4b78-ab5f-0cc128d3f9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.808929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8061e5-0bb3-4b78-ab5f-0cc128d3f9f0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.809223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8061e5-0bb3-4b78-ab5f-0cc128d3f9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.809495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8061e5-0bb3-4b78-ab5f-0cc128d3f9f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.810226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8061e5-0bb3-4b78-ab5f-0cc128d3f9f0 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=22a017e6b1d64044b4f5e3fb67cfd67f) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:50.810539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8061e5-0bb3-4b78-ab5f-0cc128d3f9f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.811974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8061e5-0bb3-4b78-ab5f-0cc128d3f9f0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.817308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7e2e9-115d-433c-aa34-7e47e89a2e11 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:50.818364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 267/537] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/role_assignments?user.id=22a017e6b1d64044b4f5e3fb67cfd67f&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:50.819672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2925a-45f9-48fb-b4ce-3a30c21b3677 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.820006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2925a-45f9-48fb-b4ce-3a30c21b3677 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.820290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2925a-45f9-48fb-b4ce-3a30c21b3677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.854065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e6d2925a-45f9-48fb-b4ce-3a30c21b3677 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:50.855312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e6d2925a-45f9-48fb-b4ce-3a30c21b3677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:50.877309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:50.897726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:50.898498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:50.898719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:50.898994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:50.916404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:50.917950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:50.946807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:50.947751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:50.948607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:50.948607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:50.948607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:50.949640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 271/538] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:50.962978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:50.972793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 268/539] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:51.044366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:51.076460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8c882-41b7-4d94-a894-bcbaf06a7184 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:51.111743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:51.112356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.112638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.112925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.113589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:51.113892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:51.115275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:51.128079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 272/540] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:51.133581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2925a-45f9-48fb-b4ce-3a30c21b3677 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:51.238909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2925a-45f9-48fb-b4ce-3a30c21b3677 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:51.280452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:51.281126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.281413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.281686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.289047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:51.290508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:51.308785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:51.309676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:51.310501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 269/541] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:51.315887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:51.316582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:51.320480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:51.474408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614f215-fec4-4b2f-b214-5d037868430a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:51.504063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44882-1613-4d8e-a0aa-36ca50d92dee None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:51.533611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:51.535777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.536269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.537589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.556868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:51.563821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:51.564695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:51.565527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:51.572946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:51.573844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.574315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.575662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.581025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 270/542] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:51.581456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:51.581878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:51.582391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:51.584032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:51.589076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:51.610476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 273/543] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:51.616668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:51.733325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:51.743618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e471ba-09b2-420f-a5e9-75ffea760f14 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:51.810213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:51.810749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.811029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.811301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.811968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:51.812269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:51.817526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:51.819141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fbd1-489e-481f-9fdd-350664dbac88 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:51.839199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 271/544] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:51.855526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:51.866042 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeaa76f-a004-458d-b8a2-90b190718599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:51.866663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa76f-a004-458d-b8a2-90b190718599 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.866984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa76f-a004-458d-b8a2-90b190718599 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.867261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeaa76f-a004-458d-b8a2-90b190718599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.867989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa76f-a004-458d-b8a2-90b190718599 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=c1a7ee9f78da46e4abe27eadb2d17b2a) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:51.868300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa76f-a004-458d-b8a2-90b190718599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:51.869772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeaa76f-a004-458d-b8a2-90b190718599 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:51.876121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 274/545] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:51 2022] GET /identity/v3/role_assignments?user.id=c1a7ee9f78da46e4abe27eadb2d17b2a&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:51.900148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c993-92f4-4b12-88a8-5474b66e0753 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.900584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c993-92f4-4b12-88a8-5474b66e0753 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.901041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0c993-92f4-4b12-88a8-5474b66e0753 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.905991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 275/546] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:51.909044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aac50-823c-4774-9a39-fa81cde33baa None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:51.909403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aac50-823c-4774-9a39-fa81cde33baa None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:51.909683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aac50-823c-4774-9a39-fa81cde33baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:51.930257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-994aac50-823c-4774-9a39-fa81cde33baa None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:51.931486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-994aac50-823c-4774-9a39-fa81cde33baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:51.992565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:52.014065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a4fea-b5e9-42b6-bc90-b6fe737b7798 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:52.017033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 276/547] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:36:52.056461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:52.066787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:52.067370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.067654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.067932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.079113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:52.080776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:52.095887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:52.096780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:52.097630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:52.097630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:52.097630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:52.097630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 272/548] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:52.106128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aac50-823c-4774-9a39-fa81cde33baa None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:52.251748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aac50-823c-4774-9a39-fa81cde33baa None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:52.302668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:52.303290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.303574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.303849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.304827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:52.305162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:52.306554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:52.323533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 277/549] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:52.328737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:52.392700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:52.473290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:52.478336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62a0d2-8285-45cc-abe4-1e9839e59cb2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:52.516457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:52.517244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.517539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.517806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.526568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:52.528160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:52.542125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:52.548450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:52.549573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 273/550] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:52.552400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:52.600137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:52.621665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf61e2-2100-4dd3-b6ce-80ec1910c082 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:52.682155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:52.682796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.683078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.683514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.695130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:52.700924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:52.701813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:52.702784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:52.703880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 278/551] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:52.709942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:52.729858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c0f24-a01b-4cc9-82cb-a3ed440f92aa None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:52.766845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:52.767832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.768304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.768773 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.769705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:52.770335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:52.772079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:52.794980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 274/552] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Sep 3 03:36:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:52.796519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:52.895371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:52.903255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e629fb9-1a4b-4604-b675-d76cc91b36c8 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:52.924601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf08367-a833-476a-ade4-e778e59a882d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:52.927260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:52.943394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda02c4-be7a-4157-b862-1409bfa0f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:52.944250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda02c4-be7a-4157-b862-1409bfa0f4bb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.944667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda02c4-be7a-4157-b862-1409bfa0f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.945160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda02c4-be7a-4157-b862-1409bfa0f4bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.968242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9511bd-c316-4cfb-8603-f2992ea5da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:52.969062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9511bd-c316-4cfb-8603-f2992ea5da07 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.969442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9511bd-c316-4cfb-8603-f2992ea5da07 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.969814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9511bd-c316-4cfb-8603-f2992ea5da07 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.970630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9511bd-c316-4cfb-8603-f2992ea5da07 None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:52.971062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9511bd-c316-4cfb-8603-f2992ea5da07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:52.972815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9511bd-c316-4cfb-8603-f2992ea5da07 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:52.985256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 279/553] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:52.985256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5923a8-bffe-433f-a214-f48d4d89d565 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.985256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5923a8-bffe-433f-a214-f48d4d89d565 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.985256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5923a8-bffe-433f-a214-f48d4d89d565 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:52.985256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 280/554] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:52.990873 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd695-feb2-43f8-9e1e-ff4d98ae1ca5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:52.991160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd695-feb2-43f8-9e1e-ff4d98ae1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:52.991430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd695-feb2-43f8-9e1e-ff4d98ae1ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.016004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-22afd695-feb2-43f8-9e1e-ff4d98ae1ca5 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:53.017926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-22afd695-feb2-43f8-9e1e-ff4d98ae1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:53.024465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda02c4-be7a-4157-b862-1409bfa0f4bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:53.026176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda02c4-be7a-4157-b862-1409bfa0f4bb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:53.092328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 281/555] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:53.093650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd695-feb2-43f8-9e1e-ff4d98ae1ca5 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.135026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:53.148130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 275/556] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:36:53.150239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54751-5abf-42cf-bb4a-70a5a764209c None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.150730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54751-5abf-42cf-bb4a-70a5a764209c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.151220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54751-5abf-42cf-bb4a-70a5a764209c None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.153484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 276/557] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:53.154571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b54751-5abf-42cf-bb4a-70a5a764209c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.230691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:53.237573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd695-feb2-43f8-9e1e-ff4d98ae1ca5 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.279512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b54751-5abf-42cf-bb4a-70a5a764209c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.280681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77cb1-32bd-4c2c-b708-f9ff294a0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.281693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77cb1-32bd-4c2c-b708-f9ff294a0b93 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.282284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77cb1-32bd-4c2c-b708-f9ff294a0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.282747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77cb1-32bd-4c2c-b708-f9ff294a0b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.293657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77cb1-32bd-4c2c-b708-f9ff294a0b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:53.295562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77cb1-32bd-4c2c-b708-f9ff294a0b93 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-87b77cb1-32bd-4c2c-b708-f9ff294a0b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:53.311461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:53.312373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:53.313300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:53.313300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:53.313300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:53.318966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 282/558] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:53.318966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f203d7-0cc5-4b42-b710-4162ce54d1ec None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.318966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f203d7-0cc5-4b42-b710-4162ce54d1ec None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.318966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f203d7-0cc5-4b42-b710-4162ce54d1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.324505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.325466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.325958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.326421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.336571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-91f203d7-0cc5-4b42-b710-4162ce54d1ec None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:53.338108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-91f203d7-0cc5-4b42-b710-4162ce54d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:53.338900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:53.340870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:53.357235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:53.358159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:53.359024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:53.359024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:53.359024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:53.360985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 277/559] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:53.362448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.410392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 283/560] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:53.411683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f203d7-0cc5-4b42-b710-4162ce54d1ec None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.423594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:53.490742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b87ebc-f502-471c-96d2-39cfe547a8c8 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.495965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:53.520271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f203d7-0cc5-4b42-b710-4162ce54d1ec None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.537981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.539399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.539876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.540333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.541197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:53.542220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:53.544081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:53.556904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.557486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.557832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.558159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.558919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:53.559220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:53.560670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:53.561695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 278/561] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:53.562766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.585907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 284/562] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:53.585907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.696757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03978bcf-6cd5-43b1-9bfd-04f9614be052 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.707722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:53.717277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f544138-3d18-4621-aa49-0586ff91dac5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.736881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.737753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.738318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.738613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] PATH_INFO: `/v3/roles/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.750059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:53.752314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.752938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.753309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.753581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:53.755384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:53.756277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:53.757164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 279/563] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:53.758260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.766257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:53.767814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:53.769882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:53.780527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:53.781779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:36:53.782707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:53.790576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 285/564] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:53.790576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.884416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec2fc-fa53-4aa0-b21b-40cb095de4df None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.896019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d170a56-5972-45d2-9dc5-c57aa8c81717 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:53.917599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.918232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.918514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.918787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.925596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:53.927044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:53.931718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:53.932355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:53.932637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:53.932933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:53.938437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:53.939336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:53.940189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 280/565] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:53.940646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.953335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:53.959246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:53.960152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:53.961090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 286/566] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:53.961762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:53.976642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.019976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.052956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fa79c-e49d-417f-9897-cd9e860a8f43 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.063058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01abd4-b838-4885-8f29-93010629a877 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.087262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.087862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.088140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.088405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.089096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.089396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.090961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.096331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.096940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.097261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.097536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.098237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.098544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.098665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 281/567] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.099377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.100024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.118686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 287/568] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:36:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.119557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.194397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.206038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e30c7-cf21-41b0-8a84-ee54e9a947f9 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.225377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac04bd-5b25-46f2-b8e8-a8e5b79b1da0 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.239903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9463-88f3-4115-87f3-f382a0769dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.240501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9463-88f3-4115-87f3-f382a0769dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.240779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9463-88f3-4115-87f3-f382a0769dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.241092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9463-88f3-4115-87f3-f382a0769dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.241947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9463-88f3-4115-87f3-f382a0769dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.242257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9463-88f3-4115-87f3-f382a0769dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.242581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.243674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9463-88f3-4115-87f3-f382a0769dd2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.255839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 282/569] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.257018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836051a5-b63b-40e7-9bbb-eb9024416c19 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.257365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836051a5-b63b-40e7-9bbb-eb9024416c19 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.257637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836051a5-b63b-40e7-9bbb-eb9024416c19 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.258919 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 283/570] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:54.259603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836051a5-b63b-40e7-9bbb-eb9024416c19 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.265587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.266203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.266486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.266759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.267429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.267732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.269146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.277554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 288/571] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.278381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.359017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836051a5-b63b-40e7-9bbb-eb9024416c19 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.379721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374cc62-f22b-4888-b23b-ed9e20c886cc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.393336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.393935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.394215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.394490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.404836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.406325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.413764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d58511-2aa5-494e-b214-c181ad4936b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.414398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d58511-2aa5-494e-b214-c181ad4936b9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.414688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d58511-2aa5-494e-b214-c181ad4936b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.414955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d58511-2aa5-494e-b214-c181ad4936b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:54.420666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:54.421762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:54.422733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:54.422733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:54.422733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:54.422733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 284/572] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:54.422949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.425436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.427860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d58511-2aa5-494e-b214-c181ad4936b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.429543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d58511-2aa5-494e-b214-c181ad4936b9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-95d58511-2aa5-494e-b214-c181ad4936b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:54.444373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:54.445818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:54.446692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:54.446692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:54.446692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:54.446692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 289/573] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:54.447325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f049b-c5e1-4a4b-b196-18611945ac18 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.447609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f049b-c5e1-4a4b-b196-18611945ac18 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.447884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f049b-c5e1-4a4b-b196-18611945ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.465943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-3b7f049b-c5e1-4a4b-b196-18611945ac18 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:54.467066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3b7f049b-c5e1-4a4b-b196-18611945ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:54.491002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.534139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 290/574] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:54.534781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda9adb-6793-4114-b0b6-9a2139fa1497 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.534956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f049b-c5e1-4a4b-b196-18611945ac18 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.567976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.568582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.568862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.569165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.569974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=fe8b2e7f400346f3bcfdedeed017e6ee) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.570374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.571657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.576985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 285/575] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/role_assignments?user.id=fe8b2e7f400346f3bcfdedeed017e6ee&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.577760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.665335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.668554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f049b-c5e1-4a4b-b196-18611945ac18 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.706334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c529661-6c83-4158-a89e-0c782eb6747d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.719184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.722384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.722685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.722958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.735507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.737339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:54.754040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:54.755069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:54.756250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:54.756250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:54.756250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:54.756250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 291/576] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:54.760965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.761095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.761095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.761380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.761572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.762181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.762479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.763853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.777609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.779301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 286/577] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.781268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.872817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f84e83-473c-4957-bc4b-70a3abc29517 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.889277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d4002-24cf-4d0e-bdd5-39d1bb88c508 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:54.908795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.909539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.909817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.910089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.910758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.911064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.912648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.914815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:54.926001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 292/578] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.926432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:54.926825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:54.927619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:54.928112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:54.928569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:54.929841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:54.931009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:54.932531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:54.946083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 287/579] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:54.947284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.008229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.039026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f27b57-1696-4d31-928a-21f2a6dddc23 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.054602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46de55-1e46-4f70-b874-1e69e7d73361 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.074455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.075084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.075363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.075632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.082880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.084411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.091170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.092025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.092475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.092932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:55.096444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:55.097444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 293/580] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:55.098379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.108757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:55.114570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:55.115492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:55.116398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:55.120435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 288/581] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:55.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.172796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.220049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509723b-6665-4fda-9f18-4d62086e9701 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.232666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb69fc-eb66-442d-915a-1ad4a4033830 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.255642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.261443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.262121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.262732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.262732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.269884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.271354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.272904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.273803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.274143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.274464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.283253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:55.284297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:55.285373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:55.286481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:55.287001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.290443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 294/582] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:55.291207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:55.298847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:55.299948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:55.301029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 289/583] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:55.301615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.403102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0a6a-654c-449e-aa15-e3a9ee0d538d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.403640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5583a-08b0-4dde-96f1-e1bbb1d81372 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.411056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.440069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.440522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.440707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.440982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.441155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.441262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.441432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.441702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.441967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:55.442270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.442371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:55.442636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.443712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.443968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.456970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 290/584] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:55.456970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.465631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 295/585] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:55.466531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.518890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.576769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d853-7de3-4cb1-ada3-a6941b1a4993 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.578356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a1835-d67d-45df-9318-d9099ccb43ee None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.614052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.614828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.615034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.615288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.615650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.615743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.615929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.616197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.617219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:55.617397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:55.617668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.617818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.619206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.619391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.637708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 291/586] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:55.637708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.642091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 296/587] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:55.646493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.667547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.742183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886cf4-a274-4eda-9085-ea1541b776ae None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.754138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16ecf-7f0b-479c-969a-e63bc56477a9 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.764304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.776896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.777497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.777778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.778046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.788738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.790422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.792236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.793194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.793479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.793751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:55.805041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:55.806145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:55.807181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:55.807181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:55.807181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:55.808120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.809763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.810720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 292/588] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:55.811557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:55.827735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:55.828908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:55.830082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:55.830082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:55.830082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:55.833222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 297/589] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:55.834207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:55.908906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:55.930743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69acdb4-217c-49b5-a9e2-5ed76a9c894b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.939579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f7032-4116-41e0-9e8b-73e3488e5bf7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:55.967722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.968475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.968826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.969192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/b74a8d0579ba402c8f64fa7a6bb24658/roles/1b9d5a0d48404d25866dbae57a2f8ef1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.975142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:55.975848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:55.976221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:55.976567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:55.984845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=b74a8d0579ba402c8f64fa7a6bb24658, role_id=1b9d5a0d48404d25866dbae57a2f8ef1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.986704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:55.988289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:55.989847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.001164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 293/590] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:55 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/b74a8d0579ba402c8f64fa7a6bb24658/roles/1b9d5a0d48404d25866dbae57a2f8ef1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:56.002060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:56.005944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:56.007053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:56.008297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:56.008297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:56.008297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:56.010244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 298/591] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:56.011416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.039043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:56.138348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a37f1-39b7-4e7f-b2f4-d1d731035eb2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.150803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a71b27-4c90-45f3-8d2b-c38f047ecd85 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.187963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:56.190194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.191415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.191415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.191585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.192570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:56.192570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.193882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.200060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.200770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.201358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.201490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.202247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:56.202643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.204148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.211723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 299/592] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:56.211723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.221486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 294/593] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:56.222193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.298035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:56.332213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a9463-79b1-4b91-9aac-7fa709b004c9 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.348228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456aa88a-c889-44f1-a4fb-04ffa5084946 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.378255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.379630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.380120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.380800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.381776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:56.382335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.384751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.391002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.391742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.392092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.392436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.400061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.401342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 300/594] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:56.402364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.405267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:56.418995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:56.419966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:56.420845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:56.425049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 295/595] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:56.425981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.493313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:56.528301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901a67c-217e-4863-8891-40be93ae9943 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.530474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e303b7-cc08-444b-b2b0-80f98c84e27f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.559557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:56.565423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.566067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.566359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.566634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.568190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2cd769-cdd5-4069-886d-53491e2579a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.569984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd769-cdd5-4069-886d-53491e2579a4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.570507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd769-cdd5-4069-886d-53491e2579a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.570929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2cd769-cdd5-4069-886d-53491e2579a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.574644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.576099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.579344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd769-cdd5-4069-886d-53491e2579a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.580938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2cd769-cdd5-4069-886d-53491e2579a4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:56.587837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:56.589009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 301/596] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:56.590560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-dd2cd769-cdd5-4069-886d-53491e2579a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:56.598700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:56.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:56.600518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 296/597] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:56.601963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dbeb9-1d9a-425b-be89-ea35866f32a8 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.601963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dbeb9-1d9a-425b-be89-ea35866f32a8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.602150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dbeb9-1d9a-425b-be89-ea35866f32a8 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.603399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 297/598] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:56.605704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dbeb9-1d9a-425b-be89-ea35866f32a8 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.707751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c404e5c-21b6-4e3d-bb07-43a5bb89979f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.708118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dbeb9-1d9a-425b-be89-ea35866f32a8 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.718799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:56.745156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.745778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.746032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.746307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.747039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:56.747345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.748778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.749855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb909c-2c5f-4cd6-9e8d-104b6ec6becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.750845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb909c-2c5f-4cd6-9e8d-104b6ec6becc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.752068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb909c-2c5f-4cd6-9e8d-104b6ec6becc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.752574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb909c-2c5f-4cd6-9e8d-104b6ec6becc None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.753509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb909c-2c5f-4cd6-9e8d-104b6ec6becc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:56.754025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb909c-2c5f-4cd6-9e8d-104b6ec6becc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.755646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb909c-2c5f-4cd6-9e8d-104b6ec6becc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.766044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 298/599] 10.222.0.13 () {56 vars in 1139 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:56.766851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.772759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 302/600] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:56.774317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49a03-ae55-4666-943b-7f63b3d1f131 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.774824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49a03-ae55-4666-943b-7f63b3d1f131 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.775291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49a03-ae55-4666-943b-7f63b3d1f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.793839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-cde49a03-ae55-4666-943b-7f63b3d1f131 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:56.795324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cde49a03-ae55-4666-943b-7f63b3d1f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:56.843252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:56.863924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 303/601] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:56.864885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49a03-ae55-4666-943b-7f63b3d1f131 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.875801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db78d-50b3-4896-935d-b399e033e492 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:56.918276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:56.919195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:56.919662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:56.920158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:56.921584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:56.922102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:56.924662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:56.942716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 299/602] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:56.943771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:56.986114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:57.004356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49a03-ae55-4666-943b-7f63b3d1f131 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.040565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.041301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.041581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.041854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.052259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.053740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:57.068862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:57.070029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:57.070982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:57.070982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:57.070982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:57.070982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 304/603] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:57.071339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.086868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9a22-033c-4126-953a-12a4b572d4d7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.107885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:57.128310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.129285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.129713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.130221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/22a017e6b1d64044b4f5e3fb67cfd67f/roles/1b9d5a0d48404d25866dbae57a2f8ef1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.147475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=22a017e6b1d64044b4f5e3fb67cfd67f, role_id=1b9d5a0d48404d25866dbae57a2f8ef1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.149719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.170584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 300/604] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:56 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/22a017e6b1d64044b4f5e3fb67cfd67f/roles/1b9d5a0d48404d25866dbae57a2f8ef1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:57.171746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.195902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd54e89-497d-4be8-8662-7f6c0e3ffac7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.242938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.244083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.244556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.245052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/21baacaa1f1c4342aacda4c967a6da58/roles/1b9d5a0d48404d25866dbae57a2f8ef1` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.262034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=21baacaa1f1c4342aacda4c967a6da58, role_id=1b9d5a0d48404d25866dbae57a2f8ef1)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.263227 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:57.264171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.283275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 305/605] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:57 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/21baacaa1f1c4342aacda4c967a6da58/roles/1b9d5a0d48404d25866dbae57a2f8ef1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:36:57.284756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.289987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921d0f-8d70-4bd4-b2a8-00660be9d799 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.330991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.331620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.331906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.332241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.332903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:57.334118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.335666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.349373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 301/606] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:57.355764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.403857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:57.421059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ca5d-7d55-49d5-bb89-3cdececd45d4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.459426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.460079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.460491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.460775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.472349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:57.477778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:57.478722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:57.479561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 306/607] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:57.484523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c23c47-384b-4593-909b-5f69b0d78fd6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.497069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.527468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.528674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.529255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.529719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.539263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.541920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.548702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:57.562688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:57.563636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:57.564576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 302/608] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:57.569246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.628527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145ace7-16a2-4dfd-90c5-a94c796c2635 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.665335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.666322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.666792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.667248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.668095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:57.668583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.670302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.679851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 307/609] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:57.689926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.696594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cf5e2-afaa-4744-8b11-91edd8ba963e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.706104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:57.736588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.737539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.738029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.738425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.739241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:57.739685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.741407 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.758996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 303/610] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:57.761865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.837186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:57.845216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214d58-2db4-4ee0-be51-1aeed39bb98f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.884215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.884862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.885171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.885446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:57.905639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:57.907133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:57.925208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284be43-c32f-47ad-b421-7bb79dec5f8c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:57.933680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:57.934832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:57.935891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:57.935891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:57.935891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:57.939951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 308/611] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:57.943518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:57.987364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:57.988134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:57.988488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:57.988838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/c1a7ee9f78da46e4abe27eadb2d17b2a/roles/1b9d5a0d48404d25866dbae57a2f8ef1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.017433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=c1a7ee9f78da46e4abe27eadb2d17b2a, role_id=1b9d5a0d48404d25866dbae57a2f8ef1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:58.019094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:58.040428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 304/612] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:57 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/c1a7ee9f78da46e4abe27eadb2d17b2a/roles/1b9d5a0d48404d25866dbae57a2f8ef1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:36:58.069352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:58.093369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a3fb0-012b-40b3-b6ea-082293add9fb None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:58.140779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fc018-fad8-4e70-8957-947652d3079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:58.141568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc018-fad8-4e70-8957-947652d3079e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:58.141907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc018-fad8-4e70-8957-947652d3079e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:58.142189 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fc018-fad8-4e70-8957-947652d3079e None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.142848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fc018-fad8-4e70-8957-947652d3079e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:58.143203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fc018-fad8-4e70-8957-947652d3079e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:58.144655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fc018-fad8-4e70-8957-947652d3079e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:58.163257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 309/613] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:58.169185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:58.230322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a8dce-b7a7-4a37-ab2e-c8c1624dc5ed None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:58.230505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a8dce-b7a7-4a37-ab2e-c8c1624dc5ed None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:58.230838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a8dce-b7a7-4a37-ab2e-c8c1624dc5ed None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.232283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 310/614] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:36:58.238312 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a5e6-17ea-46c2-984c-3d14f5698ed1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:58.238608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a5e6-17ea-46c2-984c-3d14f5698ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:58.238963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a5e6-17ea-46c2-984c-3d14f5698ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.266416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b7b4a5e6-17ea-46c2-984c-3d14f5698ed1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:58.267634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b7b4a5e6-17ea-46c2-984c-3d14f5698ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:58.330929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d239d-e7b3-441a-8468-cfdc8324904f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:58.349275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:58.389115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:58.389887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:58.390178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:58.390453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] PATH_INFO: `/v3/users/swift` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.397927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:58.399086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 311/615] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:58.399439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:58.411669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:58.412841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:58.413967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 305/616] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:36:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:58.418979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4a5e6-17ea-46c2-984c-3d14f5698ed1 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:58.530618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:58.610580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4a5e6-17ea-46c2-984c-3d14f5698ed1 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:58.661789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:58.662404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:58.662688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:58.662958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.663833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:58.664144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:58.665636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:58.685434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:58.688883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 312/617] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Sep 3 03:36:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:58.694121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:58.851356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d10d45-ef94-4865-a2f4-f6f37820e4dd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:58.869237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:58.883875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abf179-92df-45c9-bc0f-7a69bc075b1e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:58.925397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:58.926043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:58.927951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:58.928240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.949000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:58.950485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:58.955083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:58.955734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:58.956017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:58.956293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:58.980100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:58.985222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:58.986182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:58.987358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:58.987358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:58.987358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:36:58.989688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:58.992024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:36:58.994231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:58.996681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 313/618] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:58.996681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.000574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 306/619] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:36:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:59.002148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.056870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:59.191820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ce8a0-bd9e-4940-8dfe-737c45b7d5a0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:59.197844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2aa0b5-f731-4885-88ff-8f88b0c38e85 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:59.258635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:59.259262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.259547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.259826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.260503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:59.260811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:59.262239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:59.266727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:59.267404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.267690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.267962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.268611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:59.268937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:59.270320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:59.285321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 307/620] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:36:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:59.291071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.297347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 314/621] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:59.298254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.338818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:59.418774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:59.422215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1e11c-87ca-4d40-affe-1afa7a5055aa None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:59.460001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:59.460924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.461350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.461629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.473552 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:59.476164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:36:59.493545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:59.495842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:36:59.497847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:36:59.497847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:36:59.497847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:59.497847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 308/622] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:36:59.504032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.541824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba761-721f-4bd7-b11d-6027e4c78802 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:59.578817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d04f72-0387-41ba-a010-729c392c3430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:59.579773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04f72-0387-41ba-a010-729c392c3430 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.580228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04f72-0387-41ba-a010-729c392c3430 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.580723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d04f72-0387-41ba-a010-729c392c3430 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.588545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04f72-0387-41ba-a010-729c392c3430 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:59.590384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d04f72-0387-41ba-a010-729c392c3430 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-90d04f72-0387-41ba-a010-729c392c3430 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:36:59.603285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:59.604229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:36:59.605186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 315/623] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:36:59.605677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e370e4-1e2b-4672-8198-375d8af11275 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.606904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e370e4-1e2b-4672-8198-375d8af11275 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.606904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e370e4-1e2b-4672-8198-375d8af11275 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.608113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 316/624] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:59.613273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567bcb-0a64-4494-9b45-4763fdf9c56b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.613554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567bcb-0a64-4494-9b45-4763fdf9c56b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.613826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567bcb-0a64-4494-9b45-4763fdf9c56b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.616739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 317/625] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:36:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:36:59.616739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56567bcb-0a64-4494-9b45-4763fdf9c56b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.643914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa9718-9460-4dbd-9cc5-09cf72ce157f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:59.680380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961f224-74e3-48db-9790-06daa22a22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:59.681014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f224-74e3-48db-9790-06daa22a22e5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.681375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f224-74e3-48db-9790-06daa22a22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.681717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961f224-74e3-48db-9790-06daa22a22e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.682363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961f224-74e3-48db-9790-06daa22a22e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:59.682665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961f224-74e3-48db-9790-06daa22a22e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:59.684031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961f224-74e3-48db-9790-06daa22a22e5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:59.696567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 309/626] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:36:59.697819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18dd54-0125-47f0-bdd7-475dcb5332ae None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.698181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18dd54-0125-47f0-bdd7-475dcb5332ae None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.698380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18dd54-0125-47f0-bdd7-475dcb5332ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.704546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:59.705991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:59.717984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ce18dd54-0125-47f0-bdd7-475dcb5332ae None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:59.719184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ce18dd54-0125-47f0-bdd7-475dcb5332ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:59.729002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56567bcb-0a64-4494-9b45-4763fdf9c56b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:59.766790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18615e73-9788-4cf5-9f07-bc0176d26fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:59.767401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615e73-9788-4cf5-9f07-bc0176d26fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.767677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615e73-9788-4cf5-9f07-bc0176d26fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.768061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18615e73-9788-4cf5-9f07-bc0176d26fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.768746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18615e73-9788-4cf5-9f07-bc0176d26fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:36:59.769080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18615e73-9788-4cf5-9f07-bc0176d26fa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:59.770519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18615e73-9788-4cf5-9f07-bc0176d26fa3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:59.783210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 318/627] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:36:59.784478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287026ca-999f-40b7-adc7-be06310ee066 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.784766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287026ca-999f-40b7-adc7-be06310ee066 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.785078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287026ca-999f-40b7-adc7-be06310ee066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.793867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 310/628] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:59.794985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18dd54-0125-47f0-bdd7-475dcb5332ae None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.807266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-287026ca-999f-40b7-adc7-be06310ee066 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:36:59.808446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-287026ca-999f-40b7-adc7-be06310ee066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:36:59.894192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 319/629] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:36:59.895111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287026ca-999f-40b7-adc7-be06310ee066 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:36:59.913650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18dd54-0125-47f0-bdd7-475dcb5332ae None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:36:59.952349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:59.960154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:36:59.961087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:36:59.961377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:36:59.961681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:36:59.970968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:36:59.971654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:36:59.973284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:36:59.987976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:36:59.989084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:36:59.990063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:36:59.992871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 311/630] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:36:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:00.009313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.014602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287026ca-999f-40b7-adc7-be06310ee066 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.052067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.052806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.053036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.053310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/fe8b2e7f400346f3bcfdedeed017e6ee/roles/1b9d5a0d48404d25866dbae57a2f8ef1` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.068559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=fe8b2e7f400346f3bcfdedeed017e6ee, role_id=1b9d5a0d48404d25866dbae57a2f8ef1)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:00.070230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:00.088025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 320/631] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:36:59 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/fe8b2e7f400346f3bcfdedeed017e6ee/roles/1b9d5a0d48404d25866dbae57a2f8ef1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:37:00.169468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8105640-fd5b-46c4-ba3e-9b6ad342bd0b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.191972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.212972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.213754 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.213754 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.214049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.214803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:00.215109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:00.216597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:00.238622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 312/632] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:00.245488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.322082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:00.369522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e1d87-34f1-4bc8-97b5-f95e1c317136 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.380257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40e904-f0a2-4eea-8fd4-980310ecc36f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.388699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:00.407535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.408335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.408541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.408813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.415920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.416537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.416822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.417137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.420458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:00.425469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:00.426472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:00.427358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 321/633] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:00.428029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.493618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:00.495009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:00.536693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a2c15-e453-479b-8214-6f5f73b190fa None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.547303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:00.572697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f71260-82d4-401f-9cfa-dba8a96cb7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.573370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71260-82d4-401f-9cfa-dba8a96cb7b6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.573654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71260-82d4-401f-9cfa-dba8a96cb7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.573927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f71260-82d4-401f-9cfa-dba8a96cb7b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.584291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f71260-82d4-401f-9cfa-dba8a96cb7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-19f71260-82d4-401f-9cfa-dba8a96cb7b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:00.589303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:00.590231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 322/634] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:00.596214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cf90e-126b-432e-b11c-537e9333a545 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.597566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cf90e-126b-432e-b11c-537e9333a545 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.597566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cf90e-126b-432e-b11c-537e9333a545 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.597689 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 323/635] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:00.598511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cf90e-126b-432e-b11c-537e9333a545 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.604563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 313/636] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:37:00.605850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.643558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:00.708677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cf90e-126b-432e-b11c-537e9333a545 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.713187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cfb17-4d8a-46d6-acd8-8e34129b6c4a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.746500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96682354-5542-484f-bd81-33283daf7e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.747028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96682354-5542-484f-bd81-33283daf7e64 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.747344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96682354-5542-484f-bd81-33283daf7e64 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.747570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96682354-5542-484f-bd81-33283daf7e64 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.747932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.748227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96682354-5542-484f-bd81-33283daf7e64 None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:00.748525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96682354-5542-484f-bd81-33283daf7e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:00.748618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.748806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.749121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.749780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:00.749942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96682354-5542-484f-bd81-33283daf7e64 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:00.750101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:00.751429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:00.763137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 324/637] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:00.763137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b586b-104b-45c7-8554-00d96f3389da None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.763137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b586b-104b-45c7-8554-00d96f3389da None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.763137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b586b-104b-45c7-8554-00d96f3389da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.764321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 314/638] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:00.765052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.781161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:00.781728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a06b586b-104b-45c7-8554-00d96f3389da None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:00.782972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a06b586b-104b-45c7-8554-00d96f3389da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:00.854006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 325/639] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:00.854650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b586b-104b-45c7-8554-00d96f3389da None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:00.881259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9e60-b435-4707-8a69-61f6d7de0f64 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.885168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:00.930995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:00.932331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:00.932817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:00.933311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:00.949331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:00.951973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:00.959548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b586b-104b-45c7-8554-00d96f3389da None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:00.971328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:00.972308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:00.973335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:00.973335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:00.973335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:00.978242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 315/640] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:00.978242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.003886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.004821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.005352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.005791 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.017631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.019370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:01.035226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:01.036183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:01.037098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:01.037098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:01.037098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:01.039438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 326/641] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:01.040414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.061396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.110721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1e5fd-6f40-4b4c-90da-aa6dc4ba8f4d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.137621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.153643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.154592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.154941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.155278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.156084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef7757-9908-4b46-9c35-11ea96e58103 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.173443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.175426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.190626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.191320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.191666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.192003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.192713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:01.193130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:01.193666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:01.194797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:01.196069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:01.196069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:01.196069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:01.196350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.196555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 316/642] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:01.197344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.212696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 327/643] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:01.213890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.306618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5e1b1-e579-4356-a293-525375cdec14 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.322314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1461442-1bd3-4d9a-af4a-7cca2edbec5b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.323458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.344278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.345011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.345258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.345524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.346161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:01.346459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.347821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.357783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.358417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.358702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.358977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.365128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 317/644] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:01.365128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.376719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:01.381890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:01.382969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:01.383876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:01.387860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 328/645] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:01.388709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.392266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.472542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a1a8-0bd8-4883-ae10-542cc2dd2bf5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.498417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa383-14a8-450b-9b3d-ba1c57e96a93 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.509945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.510560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.510842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.511120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.511768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:01.512076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.513598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.529217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 318/646] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:01.530396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.536232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.536872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.537185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.537490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.546008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.547459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:01.559008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:01.559862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:01.560732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:01.564882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 329/647] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:01.565774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.570070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.631738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.644690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25493fb3-377d-48e5-be82-de1717d20c04 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.674240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52de105-a04e-47fd-ab4e-92b303d731c7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.679996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.680747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.681077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.681353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.689437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.690880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:01.702509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:01.703474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 319/648] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:01.704394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.715860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.716466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.716743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.717056 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.717760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:01.718025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.719424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.728272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 330/649] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:01.729105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.804776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.812061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37e9d0-8f8b-4ae1-917c-c93942d2d0d6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.834381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831f61c-3912-4c27-ac72-e6f814e0de3d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:01.846707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.847347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.847633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.847906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.856288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.857783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.858245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:01.870253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:01.871398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:37:01.872772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:01.873455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:01.873455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:01.873455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:01.873455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:01.874123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:01.874496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:01.876075 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:01.876235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 320/650] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:01.876909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.893983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 331/651] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:01.893983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:01.985593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3473777-4f98-41d7-9875-23109a1ded5a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.001809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6708ce-2458-4061-b493-1a01efd47fff None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.019324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.019927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.020202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.020477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.021232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:02.021537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.023030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.045460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 321/652] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:02.045460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.047735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.048442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.048785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.049944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.060344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.061711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.062006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:02.078683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:02.079953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:02.081193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:02.081193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:02.081193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:02.081193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 332/653] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:02.081193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.114804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.149859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334a2a-81f1-4136-8889-03f242e0e556 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.179800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087850-c40a-4e89-9148-d506a18771fc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.183789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.184398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.184681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.184986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.185717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:02.186024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.187591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.204334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 322/654] 10.222.0.13 () {56 vars in 1137 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:02.205172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.214744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67361127-a508-44b1-a35d-fadce0d23517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.215407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67361127-a508-44b1-a35d-fadce0d23517 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.215693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67361127-a508-44b1-a35d-fadce0d23517 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.215962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67361127-a508-44b1-a35d-fadce0d23517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.216684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67361127-a508-44b1-a35d-fadce0d23517 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=b74a8d0579ba402c8f64fa7a6bb24658) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:02.217079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67361127-a508-44b1-a35d-fadce0d23517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.218455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67361127-a508-44b1-a35d-fadce0d23517 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.224341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 333/655] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/role_assignments?user.id=b74a8d0579ba402c8f64fa7a6bb24658&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:02.225517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703d4d-1aa7-423d-9192-d39777c3fd89 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.225832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703d4d-1aa7-423d-9192-d39777c3fd89 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.226109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e703d4d-1aa7-423d-9192-d39777c3fd89 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.227443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 334/656] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:02.228146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e703d4d-1aa7-423d-9192-d39777c3fd89 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.290491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.322319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9adfc9-0553-4ef4-bab4-a8844ad4b7f5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.357256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.362003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e703d4d-1aa7-423d-9192-d39777c3fd89 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.362457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef250-b1da-45db-829a-ba2a9c31de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.363084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef250-b1da-45db-829a-ba2a9c31de61 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.363366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef250-b1da-45db-829a-ba2a9c31de61 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.363641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef250-b1da-45db-829a-ba2a9c31de61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.400518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.401159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.401437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.401715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.402366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:02.402663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.404048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.416640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 335/657] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:02.417564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.448525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef250-b1da-45db-829a-ba2a9c31de61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.450082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef250-b1da-45db-829a-ba2a9c31de61 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.526032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.526691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dfe40-0f59-4180-ac68-6934cfee7f70 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.564089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 323/658] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:37:02.564089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6b62-4e80-4bfd-b92b-d127410e0035 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.564089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6b62-4e80-4bfd-b92b-d127410e0035 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.564089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6b62-4e80-4bfd-b92b-d127410e0035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.566605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.567215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.567492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.580872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e7dc6b62-4e80-4bfd-b92b-d127410e0035 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:02.582087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e7dc6b62-4e80-4bfd-b92b-d127410e0035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:02.596428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.637397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.639181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.657038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 324/659] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:02.657969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc6b62-4e80-4bfd-b92b-d127410e0035 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.754312 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 336/660] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:37:02.755582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.788302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc6b62-4e80-4bfd-b92b-d127410e0035 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.790178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.824092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:02.844280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.844941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.845730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.846013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.856250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.858288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:02.872367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:02.873355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 03:37:02.874305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:02.874869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b61f6-7a80-4112-8403-15d684e06b14 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:02.876956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 325/661] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:02.878050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.921003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:02.921558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:02.921839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:02.922113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:02.936454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:02.938418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:02.956794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:02.957947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:02.958889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:02.958889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:02.958889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:02.958889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 337/662] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:02.958889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:02.987519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4a93a-64ca-40f5-8e02-b1975179123a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.023339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.024284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.024828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.025133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.035973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.037581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:03.052464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:03.053533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:03.054580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:03.054580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:03.054580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:03.054580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 326/663] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:03.054816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.068891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8cba4-597b-404c-8420-9878527994e7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.072601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.083349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.106511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.107123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.107401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.107672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.108398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:03.108702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.110172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.127119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 338/664] 10.222.0.13 () {56 vars in 1139 bytes} [Sat Sep 3 03:37:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:03.127918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.186681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd82ea-4e5c-44b6-bdfe-5830e0335719 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.229222 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.229457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a492f1a-670d-44e7-8100-ea4af49f46db None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.229853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.230130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.230401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.243785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:03.249066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:03.250110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:03.250946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:03.253248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 327/665] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:03.254700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.268039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.268994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.269374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.269646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.270206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:03.270510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.271887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.288698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 339/666] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:03.288698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.315935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.345224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.375709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056fa49-69b0-475b-b232-11f8567ab1c2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.394084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbaf38-08a9-456a-8c26-f876af20f0dc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.412875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.413556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.413838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.414288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.414941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:03.415249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.416804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.428520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.433717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 328/667] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:03.433855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.433855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.433855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.434101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.500474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.501891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.529898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.538285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3cb3-43ac-43c7-8901-e53d218ac0e4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.575728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.576486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.576772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.577101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.577772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:03.578173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.579656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.581072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.593067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 329/668] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:03.593918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.610869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 340/669] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:37:03.612654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.704422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d53437-36cb-41e6-8611-abc00211db45 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.736157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7369e98-3215-4059-8616-c1d300d6d415 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.740183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.740829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.741159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.741498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.749167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.751028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:03.763696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:03.764777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 330/670] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:03.765685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.768069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.778028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.778758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.779110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.779468 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.786503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.787944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:03.799325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:03.800221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:03.801614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 341/671] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:03.802092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.834421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:03.882099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3346-e27c-4d0b-bbe4-a3cab4a8bafb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.910287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d090a2-1a29-4e06-8cd1-b444c7e1b839 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:03.923084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.923729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.924012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.924288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.935673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.937163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.947005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:03.947631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:03.947912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:03.948184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:03.953423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:03.954330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:03.955300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:03.955300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:03.955300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:03.959343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 331/672] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:03.960248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:03.966024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:03.967508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:03.991183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:03.992294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:03.993211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:03.993211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:03.993211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:03.993211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 342/673] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:03.993451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.041506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.077768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695366d-2d93-4cb3-867e-00fce3a159e2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.086847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.108010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f304fa8-b60a-4be2-b59a-dabbbab5fb59 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.114108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.114886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.115309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.115745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.116653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:04.117359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.118806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.132439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 332/674] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:04.133640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.148087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.149198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.149790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.149790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.150429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:04.150735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.152167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.169218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 343/675] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:04.169218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.244298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872578a-a8fe-47ae-9f56-3f2db0241a7d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.265013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c0394-e9a7-46b6-a194-d423bb07d4a4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.266502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.278199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.278801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.279077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.279345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.279983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:04.280283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.281684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.293717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 333/676] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:04.294470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.307570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.308181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.308462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.308736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.309421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:04.309729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.311109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.322577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 344/677] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:04.323729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.334208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.404247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3d7d-8511-4eef-bbf3-4652addd99f0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.423158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53359f2b-bd66-4f06-bdeb-dda03c2588b5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.437494 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cc285-c888-406f-bd58-870c36b49fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.438093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cc285-c888-406f-bd58-870c36b49fce None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.438371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cc285-c888-406f-bd58-870c36b49fce None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.438640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cc285-c888-406f-bd58-870c36b49fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.439358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cc285-c888-406f-bd58-870c36b49fce None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=22a017e6b1d64044b4f5e3fb67cfd67f) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:04.439661 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cc285-c888-406f-bd58-870c36b49fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.441249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cc285-c888-406f-bd58-870c36b49fce None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.446999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 334/678] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/role_assignments?user.id=22a017e6b1d64044b4f5e3fb67cfd67f&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:04.448177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106a013-8b7d-44bc-be37-dd28bb76b429 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.448420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106a013-8b7d-44bc-be37-dd28bb76b429 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.448722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106a013-8b7d-44bc-be37-dd28bb76b429 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.452968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 335/679] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:04.452968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106a013-8b7d-44bc-be37-dd28bb76b429 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.462018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.462668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.463017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.463293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.464044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=21baacaa1f1c4342aacda4c967a6da58) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:04.464354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.465847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.472443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 345/680] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/role_assignments?user.id=21baacaa1f1c4342aacda4c967a6da58&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:04.473378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.519987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.574337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.586704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106a013-8b7d-44bc-be37-dd28bb76b429 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.633937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b361d6-03f5-418e-922f-91e990d0663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.634599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b361d6-03f5-418e-922f-91e990d0663f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.634866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b361d6-03f5-418e-922f-91e990d0663f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.635146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b361d6-03f5-418e-922f-91e990d0663f None admin] PATH_INFO: `/v3/users/swift` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.638324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2714615-b29b-4230-b354-8ebd85511225 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.646148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b361d6-03f5-418e-922f-91e990d0663f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.647802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b361d6-03f5-418e-922f-91e990d0663f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-98b361d6-03f5-418e-922f-91e990d0663f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:04.661358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:04.662545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 336/681] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:04.664155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ed8b3-429f-4b89-9db8-e7c66078a478 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.665760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ed8b3-429f-4b89-9db8-e7c66078a478 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.665760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ed8b3-429f-4b89-9db8-e7c66078a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.684154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.684800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.685132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.685408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.691787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d67ed8b3-429f-4b89-9db8-e7c66078a478 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:04.692559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.693464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d67ed8b3-429f-4b89-9db8-e7c66078a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:04.694094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:04.708012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:04.709172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 346/682] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:04.711698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.784020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 337/683] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:04.784894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ed8b3-429f-4b89-9db8-e7c66078a478 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.819824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.834709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6620fb9-59bf-46c2-80ca-69f8fbd2be94 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.895370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:04.900286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.900908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.901218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.901624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.902657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:04.902972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:04.904434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:04.931479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ed8b3-429f-4b89-9db8-e7c66078a478 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:04.942087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 347/684] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:04.947461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:04.995220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:04.996290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:04.997552 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:04.998629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:04.999619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:05.001001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.002738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.029100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 338/685] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:05.034863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.128977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc27f-2a1e-416f-9685-cb205b77fb1c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.175240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.176135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.176499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.176868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.183568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b47f-2826-4f8c-ad72-cb3b1b13100d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.193231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:05.223276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.224169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.224677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.225098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.225992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=c1a7ee9f78da46e4abe27eadb2d17b2a) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:05.226463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.228189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.235200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 339/686] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/role_assignments?user.id=c1a7ee9f78da46e4abe27eadb2d17b2a&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:05.236175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.249031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:05.263904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.265966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.348388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740b59e-b41f-4519-a45b-2b30de81fe5d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.385968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.386944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.387317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.387681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.400974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:05.405791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:05.406771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:05.407593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 340/687] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:05.413939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.437001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 348/688] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:37:05.441946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.496076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:05.546258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:05.562179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff948eb-dac2-4d9f-b636-2dce9cb53380 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.584699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920b47b-593e-4650-80a2-62f79f31cde2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.600517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.601607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.602267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.602728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.614199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.616167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.621419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.622034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.622317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.622591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.623263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:05.623569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.624946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:05.634333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:05.635284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:05.636201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:05.636201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:05.636201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:05.636399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 341/689] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:05.638390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 349/690] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:05.644052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.645243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.752227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:05.758097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e853dc-17cc-4a45-9d22-5f90b3f2810c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.760276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b7db9-25a6-4d88-8f21-2c47ebd770ac None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.788735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:05.797425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.798075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.798361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.798635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.801672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.802553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.803021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.804081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.804987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:05.805525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.807148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.810648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.812088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.820611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 350/691] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:05.826247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:05.827426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:05.828406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:05.829346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:05.829346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:05.829346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:05.829346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 342/692] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:05.834711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:05.930529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134b556-40fa-4a27-ae57-13ed801000c8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.940614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784ee5-4129-4f2e-b7cb-0907ed517072 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:05.965544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.966518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.966987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.967472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.975181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.976586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:05.977302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.977518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:05.977898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:05.978294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:05.979004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:05.979405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:05.981125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:05.989938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:05.990972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:05.992146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:05.994158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 351/693] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:05.998997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 343/694] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:06.000021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:06.002775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:06.019460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:06.061292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:06.103650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b12b0-de1a-41dd-ab89-f0d932dd2b4d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:06.135362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee96589-ed3b-4a3d-a9b3-8638fea582ff None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:06.138488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:06.139595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.140033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.140454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.141326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:06.141767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:06.143339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:06.156275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 352/695] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:06.162849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:06.217747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:06.218406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.218590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.218866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.234033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:06.235575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:06.246758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:06.264524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:06.265816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:06.266735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 344/696] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:37:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:06.273889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4ecb5-c39c-456a-a6be-cba086219fc3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:06.274038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:06.322238 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:06.322848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.323124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.323393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.324118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=fe8b2e7f400346f3bcfdedeed017e6ee) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:06.324419 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:06.325900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:06.337629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 353/697] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:06 2022] GET /identity/v3/role_assignments?user.id=fe8b2e7f400346f3bcfdedeed017e6ee&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:06.432559 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:06.440259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1eb91-9302-44c0-8a7d-dddc70a41b01 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:06.485545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ce0cf-dc15-46ab-9fb2-7665e158e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:06.486081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce0cf-dc15-46ab-9fb2-7665e158e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.486676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce0cf-dc15-46ab-9fb2-7665e158e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.486950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ce0cf-dc15-46ab-9fb2-7665e158e9f7 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.487695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ce0cf-dc15-46ab-9fb2-7665e158e9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:06.488002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ce0cf-dc15-46ab-9fb2-7665e158e9f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:06.489488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ce0cf-dc15-46ab-9fb2-7665e158e9f7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:06.517850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 345/698] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:37:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:06.523530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:06.636383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4116e-d5a4-49b3-a310-5b3a31127310 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:06.671770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:06.672393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.672677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.672976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.688730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:06.710209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6638b-fc39-4638-ba4a-61d7e8c49764 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.710816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6638b-fc39-4638-ba4a-61d7e8c49764 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.711233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6638b-fc39-4638-ba4a-61d7e8c49764 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.713912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 346/699] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:06.721161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876865-aec2-404f-b888-ed963757ed73 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.721444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876865-aec2-404f-b888-ed963757ed73 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.721715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a876865-aec2-404f-b888-ed963757ed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.745533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3a876865-aec2-404f-b888-ed963757ed73 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:06.746669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3a876865-aec2-404f-b888-ed963757ed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:06.751834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:06.753382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:06.825550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 347/700] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:37:06.827095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392d46-2a4e-4784-a548-2f1dcc1ba2f3 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.827385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392d46-2a4e-4784-a548-2f1dcc1ba2f3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.827664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45392d46-2a4e-4784-a548-2f1dcc1ba2f3 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.829894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 348/701] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:06.835784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cc0d7-dfa3-4945-af0a-5d466a5925eb None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:06.836073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cc0d7-dfa3-4945-af0a-5d466a5925eb None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:06.836348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cc0d7-dfa3-4945-af0a-5d466a5925eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:06.860155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f79cc0d7-dfa3-4945-af0a-5d466a5925eb None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:06.861992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f79cc0d7-dfa3-4945-af0a-5d466a5925eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:06.867288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 354/702] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 03:37:06.876282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:06.959029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:06.987543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 349/703] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:07.055260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61209bef-404d-4cbb-acf7-ee260f95a3a9 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.104442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.105414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.105890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.106304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.110191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cc0d7-dfa3-4945-af0a-5d466a5925eb None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.125315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.128166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.139236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:07.151991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:07.153583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:07.154705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:07.154705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:07.154705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:07.160005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 355/704] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:07.166317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.278415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:07.280428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cc0d7-dfa3-4945-af0a-5d466a5925eb None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.288241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae7885-b715-4661-9d05-f01c4249f261 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.347910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.348605 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.348894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.349035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.349334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.349732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.350126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.350455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.351717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:07.352081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.354112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.360807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.362741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.369081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 356/705] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:07.369950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:07.379141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:07.380117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:07.381016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:07.381016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:07.381016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:07.385040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 350/706] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:07.386019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.475180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:07.494027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80611c9a-988a-4a1c-b498-e1ca76163f02 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.519699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77ce68-6790-47fc-8cfd-c4fd110f3680 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.530816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.531517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.531722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.531991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.532574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.534023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:07.545241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:07.546307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:07.547130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 357/707] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:07.547949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.568516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:07.571631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.572441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.572858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.573310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.582964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.585358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:07.601842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:07.602962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:07.603999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:07.606303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 351/708] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:07.607557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.660876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10a7f5-7070-45a6-82bf-b1fa53344ac5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.696222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.696839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.697175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.697452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.698094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:07.698465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.699773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.717487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 358/709] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:07.718376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.737271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c06ca-584d-4053-ad51-17916ea3e57b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.773939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:07.783133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.784635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.785271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.785839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.786677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:07.787158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.789043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.801006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 352/710] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:07.801883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.804969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:07.842309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd451e4-3c16-48ef-b999-b93afc02e660 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.889176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.890548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.891239 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.891707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.892856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:07.893467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.895603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.911198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205ae0d-ade6-4c04-969f-2e94a64a0bcb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:07.915278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 359/711] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:07.916326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:07.951057 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:07.952258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:07.952258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:07.952536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:07.953025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:07.954493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:07.985137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 353/712] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:37:07 2022] POST /identity/v3/users => generated 254 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:07.986159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:08.046670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be703c49-8cbf-47f6-ba41-132084a4b8fd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:08.054187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:08.090815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d2025-3d1b-436b-ab64-011d1033c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:08.091920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d2025-3d1b-436b-ab64-011d1033c2bd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.092421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d2025-3d1b-436b-ab64-011d1033c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.092905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d2025-3d1b-436b-ab64-011d1033c2bd None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.093883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d2025-3d1b-436b-ab64-011d1033c2bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:08.094525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d2025-3d1b-436b-ab64-011d1033c2bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:08.096366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d2025-3d1b-436b-ab64-011d1033c2bd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:08.100350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:08.109493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 360/713] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:08.111681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88bb3c-18cc-44d7-8b30-72cb46204852 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.112179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88bb3c-18cc-44d7-8b30-72cb46204852 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.112651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88bb3c-18cc-44d7-8b30-72cb46204852 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.113197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ed3e4-95d5-49db-bdc9-6e4f6118de4a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:08.114977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 361/714] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:08.122032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc357f-10c3-48ff-b757-0a22b52c471b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.122631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc357f-10c3-48ff-b757-0a22b52c471b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.123144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc357f-10c3-48ff-b757-0a22b52c471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.158609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:08.159168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.159446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.159723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.160465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=b74a8d0579ba402c8f64fa7a6bb24658) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:08.160775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:08.162290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:08.169857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 354/715] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:07 2022] GET /identity/v3/role_assignments?user.id=b74a8d0579ba402c8f64fa7a6bb24658&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:08.172138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ddfc357f-10c3-48ff-b757-0a22b52c471b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:08.177370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ddfc357f-10c3-48ff-b757-0a22b52c471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:08.262840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 362/716] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:08.549418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:08.677541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254965-b62a-4816-9514-4c8634456dcb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:08.697434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:08.721906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206caa9-2f36-4c13-96bf-0ea5a339ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:08.722545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206caa9-2f36-4c13-96bf-0ea5a339ba6f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.722824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206caa9-2f36-4c13-96bf-0ea5a339ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.723095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206caa9-2f36-4c13-96bf-0ea5a339ba6f None admin] PATH_INFO: `/v3/services/network` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.723682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206caa9-2f36-4c13-96bf-0ea5a339ba6f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:08.725088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206caa9-2f36-4c13-96bf-0ea5a339ba6f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5206caa9-2f36-4c13-96bf-0ea5a339ba6f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:08.740554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:08.741903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:08.742932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 355/717] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:08 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:08.749714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc357f-10c3-48ff-b757-0a22b52c471b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:08.784655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e9740-0b1e-423c-93e5-f33650c69c35 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.784962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e9740-0b1e-423c-93e5-f33650c69c35 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.785262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e9740-0b1e-423c-93e5-f33650c69c35 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.786718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 356/718] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:08.798171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd226f-1901-4344-8580-d927eb56993b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.798457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd226f-1901-4344-8580-d927eb56993b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.798734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd226f-1901-4344-8580-d927eb56993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.830298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c3bd226f-1901-4344-8580-d927eb56993b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:08.830298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c3bd226f-1901-4344-8580-d927eb56993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:08.912889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc357f-10c3-48ff-b757-0a22b52c471b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:08.954165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 357/719] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 03:37:08.971872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:08.984943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:08.985568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:08.985847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:08.986629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:08.987269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] RBAC: Adding query filter params (name=network) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:08.987571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:08.988983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:08.994117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 363/720] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:08.999682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd226f-1901-4344-8580-d927eb56993b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:09.115569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd226f-1901-4344-8580-d927eb56993b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:09.125028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:09.165646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:09.166269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:09.166543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:09.166810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:09.167446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] RBAC: Adding query filter params (type=network) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:09.167745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:09.169149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:09.181444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 358/721] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:09.379755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:09.516188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f27c14-cd81-4e63-a38f-619ba0b39193 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:09.553185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:09.554458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:09.554961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:09.555426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:09.567185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:09.572783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:09.573797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:09.574622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:09.577396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 364/722] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:09.585097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:09.686860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2b90f-c72d-4fb0-96c5-feea3f64b799 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:09.719906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:09.720511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:09.720788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:09.721109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:09.721765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:09.722065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:09.723431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:09.731964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 359/723] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:09.737784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:09.796261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:09.842178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792545-224f-4ded-940c-3f8c94daaf5e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:09.880397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:09.881075 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:09.881352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:09.881628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:09.895859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:09.897398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:09.912191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:09.913334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:09.914900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:09.914900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:09.914900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:09.914900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 365/724] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:09.919921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:09.955934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:10.021996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b63a2f-96f0-419c-8d3c-7ebf9248cda6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:10.072634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:10.073363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.073647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.073923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.074576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:10.074888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:10.076262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:10.094947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 360/725] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:10.100693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:10.248741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246b39b-57d6-4d55-84bf-b5e4b176db32 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:10.255853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:10.284196 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f6b5a-ac09-4e3b-a326-ea472efecf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:10.284834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6b5a-ac09-4e3b-a326-ea472efecf10 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.285144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6b5a-ac09-4e3b-a326-ea472efecf10 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.285422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6b5a-ac09-4e3b-a326-ea472efecf10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.293557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f6b5a-ac09-4e3b-a326-ea472efecf10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:10.295005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f6b5a-ac09-4e3b-a326-ea472efecf10 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-ac9f6b5a-ac09-4e3b-a326-ea472efecf10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:10.306561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:10.307552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:10.309131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 366/726] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:10.313307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:10.419029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02acfc-2f5b-4b69-8f71-47e88990021d None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.419550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02acfc-2f5b-4b69-8f71-47e88990021d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.419550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02acfc-2f5b-4b69-8f71-47e88990021d None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.421167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 367/727] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:10.426115 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c913eb-5fb6-4779-a694-e670a5e9a2a3 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.426398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c913eb-5fb6-4779-a694-e670a5e9a2a3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.426676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c913eb-5fb6-4779-a694-e670a5e9a2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.440257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:10.448892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d60ad-6038-4bf1-984f-21b5bbe80791 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:10.471508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b7c913eb-5fb6-4779-a694-e670a5e9a2a3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:10.472725 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b7c913eb-5fb6-4779-a694-e670a5e9a2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:10.525976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe232b-674b-44a6-a999-16618ad289ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:10.526954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe232b-674b-44a6-a999-16618ad289ec None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.527463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe232b-674b-44a6-a999-16618ad289ec None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.527940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe232b-674b-44a6-a999-16618ad289ec None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.528866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe232b-674b-44a6-a999-16618ad289ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:10.529396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe232b-674b-44a6-a999-16618ad289ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:10.531042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe232b-674b-44a6-a999-16618ad289ec None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:10.562787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 361/728] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Sep 3 03:37:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:10.564065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a1945-5387-403f-ac29-271440255b15 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.564351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a1945-5387-403f-ac29-271440255b15 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.564620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a1945-5387-403f-ac29-271440255b15 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.566302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 362/729] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:10.571679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a1945-5387-403f-ac29-271440255b15 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:10.575311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 368/730] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:10.578201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad67b3-664c-40cb-ae80-ba7d8babcb55 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.578718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad67b3-664c-40cb-ae80-ba7d8babcb55 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.579251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad67b3-664c-40cb-ae80-ba7d8babcb55 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.580994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 369/731] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:10.582266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedccca-2fbb-4b28-9b03-2b9705631401 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.582749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedccca-2fbb-4b28-9b03-2b9705631401 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.583631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedccca-2fbb-4b28-9b03-2b9705631401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.606648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-fbedccca-2fbb-4b28-9b03-2b9705631401 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:10.608734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fbedccca-2fbb-4b28-9b03-2b9705631401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:10.683352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a1945-5387-403f-ac29-271440255b15 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:10.694429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 370/732] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:10.696768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e0d2-86e5-42fd-a5e2-54e8c6494d62 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.697285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e0d2-86e5-42fd-a5e2-54e8c6494d62 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.697886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8e0d2-86e5-42fd-a5e2-54e8c6494d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.719265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-5db8e0d2-86e5-42fd-a5e2-54e8c6494d62 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:10.720578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5db8e0d2-86e5-42fd-a5e2-54e8c6494d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:10.726682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dda369-5046-4769-a64c-006635195ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:10.727562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dda369-5046-4769-a64c-006635195ded None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:10.728015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dda369-5046-4769-a64c-006635195ded None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:10.728481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dda369-5046-4769-a64c-006635195ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:10.744144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:10.759645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:10.798001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 371/733] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:10.816362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dda369-5046-4769-a64c-006635195ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:10.818088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dda369-5046-4769-a64c-006635195ded None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:10.858013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8e0d2-86e5-42fd-a5e2-54e8c6494d62 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:10.928410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 363/734] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 03:37:10.934569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dda369-5046-4769-a64c-006635195ded None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.008944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8e0d2-86e5-42fd-a5e2-54e8c6494d62 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.031812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.043266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.044039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.044394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.044741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.055818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:11.060760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:11.061701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:11.062660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 372/735] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:11.063525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.083572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.090174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dda369-5046-4769-a64c-006635195ded None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.125322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.126256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.126711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.127180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.137677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.139346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:11.154187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:11.155155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:11.156039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:11.156039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:11.156039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:11.158253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 364/736] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:11.159474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.179907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962bdd-32ad-4a82-a59a-09d3599fbb2a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.215320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.215956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.216243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.216521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.227352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:11.232211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:11.233178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 373/737] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:11.234731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.271170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c064171-cbd2-447a-8ca7-c75fda80632c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.274252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.309662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.310621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.311169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.311638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.312504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:11.313059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.314525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.324943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.330685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 365/738] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:11.331757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.352605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba48d9-7a71-477e-be65-dc6dfe20e988 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.389119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.389732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.390017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.390307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.390964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:11.391273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.392689 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.404490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 374/739] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:11.405336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.445447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d39ab-55f8-45fa-b06a-e4410d50c98b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.481709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.482313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.482616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.482887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.483584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.485028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.504964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 366/740] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:11 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:11.504964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.520866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874329c-10ce-4a0b-a186-02f0bc1676ef None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.551785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.568975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.575499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.576402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.576832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.577280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.578171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:11.578646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.580385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.591040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 375/741] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:11.592478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.663882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb6c90-d611-4f3f-873c-40c9bddab709 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.712477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dee713-f75d-46d7-af40-b43cd6e45933 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.718506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.719157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.719435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.719705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.732834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.734339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.752001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.753023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.753505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:11.753610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:11.754480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:11.755385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:11.755385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:11.755385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:11.755385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 367/742] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:11.756024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.756510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.765730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.768097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:11.785328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:11.786245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:11.787103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:11.789753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 376/743] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:11.790726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.862828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.869194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:11.892358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040ae20-e49c-487c-885b-b78842cf65d2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.924730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4fb6d-3339-4d27-9814-42ab749eaa8a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:11.932579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.933469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.934242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.934686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.947123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.948559 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:11.962791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:11.963917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:11.964958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:11.964958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:11.964958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:11.964958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 368/744] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:11.965332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b411a8-553c-454e-8c0b-f5d9e1b371c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:11.966109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b411a8-553c-454e-8c0b-f5d9e1b371c1 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.966544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b411a8-553c-454e-8c0b-f5d9e1b371c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.967046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b411a8-553c-454e-8c0b-f5d9e1b371c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.967840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b411a8-553c-454e-8c0b-f5d9e1b371c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:11.968286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b411a8-553c-454e-8c0b-f5d9e1b371c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:11.969214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:11.970012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b411a8-553c-454e-8c0b-f5d9e1b371c1 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:11.989452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 377/745] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:11.990908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe3ac-3abd-4789-9d41-a69c2930da4e None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:11.991901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe3ac-3abd-4789-9d41-a69c2930da4e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:11.992310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe3ac-3abd-4789-9d41-a69c2930da4e None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:11.994394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 378/746] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:11.995873 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe3ac-3abd-4789-9d41-a69c2930da4e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.074970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440b47c-3ee6-44d4-b895-3fdf706ff01f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.105150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe3ac-3abd-4789-9d41-a69c2930da4e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.105466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:12.112069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.112674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.113029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.113254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.114006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:12.114316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.115740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.121830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:12.133013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 369/747] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:12.133013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.150089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b95d06-3c65-403a-bd18-09cfadc54118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.150780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95d06-3c65-403a-bd18-09cfadc54118 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.150960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95d06-3c65-403a-bd18-09cfadc54118 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.151229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b95d06-3c65-403a-bd18-09cfadc54118 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.151869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b95d06-3c65-403a-bd18-09cfadc54118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:12.152267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b95d06-3c65-403a-bd18-09cfadc54118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.153558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b95d06-3c65-403a-bd18-09cfadc54118 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.169084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 379/748] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:12.170369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08404-aa77-44fd-8774-a50403b9c510 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.170656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08404-aa77-44fd-8774-a50403b9c510 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.170932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08404-aa77-44fd-8774-a50403b9c510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.189051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-00d08404-aa77-44fd-8774-a50403b9c510 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:12.190237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-00d08404-aa77-44fd-8774-a50403b9c510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:12.251745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd340808-e25b-482b-81f2-2ad89e4207dc None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.264948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 380/749] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 03:37:12.264948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d08404-aa77-44fd-8774-a50403b9c510 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.293087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.294022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.294305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.294584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.304059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.306172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:12.321405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:12.322354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 370/750] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:37:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:12.323280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.389285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d08404-aa77-44fd-8774-a50403b9c510 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.390468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:12.391643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:12.428235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.429266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.429935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.430371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.431308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=fe8b2e7f400346f3bcfdedeed017e6ee) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:12.431760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.433412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.439665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 381/751] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:12 2022] GET /identity/v3/role_assignments?user.id=fe8b2e7f400346f3bcfdedeed017e6ee&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:12.440790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.467248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a137b43-814f-4a59-a570-f68d2ed33fa7 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.535361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.536114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.536460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.536799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.553499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.555028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:12.578961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:12.580014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:12.581009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:12.587773 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 371/752] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:37:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:12.587773 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.590650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e10aa-94c3-4059-8fe3-1ad01a69b910 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.632478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.633168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.633501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.633798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.634519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:12.634830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.636290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.665109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 382/753] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:37:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:12.666030 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.696072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:12.728224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee0b62-8a01-4fc5-98d9-77a0121c6782 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.740852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:12.769346 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead82945-ad4a-4d8d-8141-731abfa64bb9 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.769713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.770486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.770982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.771419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.772297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.774091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.798335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 372/754] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:12 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:12.801391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.813859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:12.814617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:12.814964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:12.815295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:12.816383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:12.816383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:12.817980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:12.838665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 383/755] 10.222.0.13 () {56 vars in 1149 bytes} [Sat Sep 3 03:37:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:12.844602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:12.941709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:12.956439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e69835-2d25-4928-b1af-b44a1a3d5936 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:12.969782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1163-fbd2-4829-9ad3-26a1b876bf8e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:13.015508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.016473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.017492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.017951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.043969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.044624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.044905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.045209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.057498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.058981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:13.076399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:13.077500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:13.078387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:13.078387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:13.078387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:13.078387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 373/756] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:13.087464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:13.114262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.115726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.121144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:13.216674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:13.234534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735d11-160e-4176-b34c-6b2d31da57eb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:13.244937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 384/757] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:13.247514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:13.302895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.303504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.303866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.307855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.308521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:13.308836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.310402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.331369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 374/758] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:13.337483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:13.435491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:13.458422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef998b1-64bd-484a-8d51-0a3c4b32b6bd None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:13.471122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c5198-14eb-49ac-bf7d-954d8a07eafe None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:13.499729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189545e-c2d2-40aa-8912-1ee15ecc3873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.500368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189545e-c2d2-40aa-8912-1ee15ecc3873 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.500648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189545e-c2d2-40aa-8912-1ee15ecc3873 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.500938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189545e-c2d2-40aa-8912-1ee15ecc3873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.509578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189545e-c2d2-40aa-8912-1ee15ecc3873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.511045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189545e-c2d2-40aa-8912-1ee15ecc3873 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-b189545e-c2d2-40aa-8912-1ee15ecc3873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:13.529051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:13.530005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:13.530883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:13.531310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 375/759] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:13.532813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77eca2-b513-47af-9613-5c30e22eeb63 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.533177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77eca2-b513-47af-9613-5c30e22eeb63 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.533464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77eca2-b513-47af-9613-5c30e22eeb63 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.534776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 376/760] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:13.539106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77eca2-b513-47af-9613-5c30e22eeb63 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:13.542919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3a3b0-12f0-4fab-8791-262d25205813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.544233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3a3b0-12f0-4fab-8791-262d25205813 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.544874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3a3b0-12f0-4fab-8791-262d25205813 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.545459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3a3b0-12f0-4fab-8791-262d25205813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.561600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3a3b0-12f0-4fab-8791-262d25205813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.563502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3a3b0-12f0-4fab-8791-262d25205813 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-0ab3a3b0-12f0-4fab-8791-262d25205813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:13.580735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:13.581853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:13.582710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:13.582710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:13.582710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:13.584887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 385/761] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:13.586454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b63ec-d946-4d83-97ee-fb4fbc3e0e0b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.586932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b63ec-d946-4d83-97ee-fb4fbc3e0e0b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.587391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b63ec-d946-4d83-97ee-fb4fbc3e0e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.608513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8d3b63ec-d946-4d83-97ee-fb4fbc3e0e0b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:13.610471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8d3b63ec-d946-4d83-97ee-fb4fbc3e0e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:13.639840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:13.661041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77eca2-b513-47af-9613-5c30e22eeb63 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:13.689104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 386/762] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:13.690053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b63ec-d946-4d83-97ee-fb4fbc3e0e0b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:13.697779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.698658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.699092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.699504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.700395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:13.700844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.702522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.716417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 377/763] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:13.724488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:13.725215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:13.836400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5994e5-0605-4b80-a681-fb8d8b2dcc9b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:13.873399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.874334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.874759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.875173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/b74a8d0579ba402c8f64fa7a6bb24658/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.877364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=b74a8d0579ba402c8f64fa7a6bb24658, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.879115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.895826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 378/764] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:37:13 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/b74a8d0579ba402c8f64fa7a6bb24658/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:37:13.926646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b63ec-d946-4d83-97ee-fb4fbc3e0e0b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:13.972680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:13.973699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:13.974202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:13.974686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:13.975613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:13.976286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:13.977904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:13.995882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 387/765] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:14.001248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:14.043838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:14.095266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:14.119855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:14.168947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa5c4-9e2b-48f1-a725-fc4aaa36945e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:14.192612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003a2f-1ca0-430c-9ab1-966d059aa02c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:14.202564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:14.203204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.203618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.203895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.211415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:14.212884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:14.227224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:14.228116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:14.229029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:14.229476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:14.229476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.229476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.229761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 379/766] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:14.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:14.232937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:14.233944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:14.254770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:14.255818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:14.256673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:14.263237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 388/767] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Sep 3 03:37:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:14.266652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:14.416095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:14.433867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb3c3-1a81-4e80-ad58-8448dedd3753 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:14.438852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf57bd5-588d-464e-9148-b62a376abd21 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:14.482276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:14.482809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.483090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.483318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:14.483420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.483978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:14.484283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:14.485753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:14.497066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 389/768] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Sep 3 03:37:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:14.501639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:14.502268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.502549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.502819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.503516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:14.503820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:14.505355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:14.514673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:14.519068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 380/769] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:14.525113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:14.633634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9794b-dcc3-4b22-8bcf-70cf664aed49 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:14.671639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04b96d-1aa5-4b36-b7c5-e890e8fbd8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:14.672490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b96d-1aa5-4b36-b7c5-e890e8fbd8d1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.672820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b96d-1aa5-4b36-b7c5-e890e8fbd8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.673126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04b96d-1aa5-4b36-b7c5-e890e8fbd8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.673860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b96d-1aa5-4b36-b7c5-e890e8fbd8d1 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f0cdc86ba2a84930b1252299feab9913) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:14.674174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b96d-1aa5-4b36-b7c5-e890e8fbd8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:14.675692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04b96d-1aa5-4b36-b7c5-e890e8fbd8d1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:14.682577 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 381/770] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:14 2022] GET /identity/v3/role_assignments?user.id=f0cdc86ba2a84930b1252299feab9913&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:14.751218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa41327-6c91-4f1c-8db9-ca4310230dd0 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:14.780277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6eff9-c86d-43af-8a5d-a38a6b1370d2 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.780599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6eff9-c86d-43af-8a5d-a38a6b1370d2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.780836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6eff9-c86d-43af-8a5d-a38a6b1370d2 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.782663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 382/771] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:14.788784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8784-9438-4fab-a598-635a9d93f5c2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.789177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8784-9438-4fab-a598-635a9d93f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.789399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8784-9438-4fab-a598-635a9d93f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.814830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:14.815823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:14.816304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:14.816790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:14.817710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:14.818425 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:14.820217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:14.827697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-267a8784-9438-4fab-a598-635a9d93f5c2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:14.830338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-267a8784-9438-4fab-a598-635a9d93f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:14.836197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 390/772] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Sep 3 03:37:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:14.843210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:14.868802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:14.916037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:14.966526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 383/773] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:14.972380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c60d2-48b7-408d-a017-e21051cd18e7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:15.008395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e684cd-9b0d-4b71-981a-e3aac407a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:15.009486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e684cd-9b0d-4b71-981a-e3aac407a04c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.009998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e684cd-9b0d-4b71-981a-e3aac407a04c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.010459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e684cd-9b0d-4b71-981a-e3aac407a04c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.011402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e684cd-9b0d-4b71-981a-e3aac407a04c None admin] RBAC: Adding query filter params (interface=public, service_id=11f83ce3293e4376a88700ef94c87e8a, region_id=RegionOne) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:15.011906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e684cd-9b0d-4b71-981a-e3aac407a04c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:15.013531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e684cd-9b0d-4b71-981a-e3aac407a04c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:15.021840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 391/774] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:37:14 2022] GET /identity/v3/endpoints?service_id=11f83ce3293e4376a88700ef94c87e8a&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:15.027792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a8784-9438-4fab-a598-635a9d93f5c2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:15.169154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a8784-9438-4fab-a598-635a9d93f5c2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:15.223290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8865a-7534-47fc-b4ca-5f9e53e82fc9 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.223607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8865a-7534-47fc-b4ca-5f9e53e82fc9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.223840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8865a-7534-47fc-b4ca-5f9e53e82fc9 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.225566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 392/775] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:15.230546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79e7b-6330-4e90-bf41-f15f208a9c5b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.231121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79e7b-6330-4e90-bf41-f15f208a9c5b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.231414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:15.231813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79e7b-6330-4e90-bf41-f15f208a9c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.232033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.232315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.232589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.233234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:15.234603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:15.240891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 384/776] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:15 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:15.270207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-acb79e7b-6330-4e90-bf41-f15f208a9c5b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:15.271787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-acb79e7b-6330-4e90-bf41-f15f208a9c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:15.361724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:15.374650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 393/777] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:15.417171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:15.483583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8fc8d-f1d9-4a97-992b-db92775e3a0d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:15.521489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:15.522048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.522442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.522724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.533107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:15.538152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:15.539204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:15.540053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 385/778] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:15.545581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb79e7b-6330-4e90-bf41-f15f208a9c5b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:15.565278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:15.648851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb79e7b-6330-4e90-bf41-f15f208a9c5b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:15.675956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:15.702721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:15.703347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.703624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.703893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.704563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:15.704860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:15.706267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:15.729232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 394/779] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:15.736160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:15.869411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:15.870860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:15.872947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3fdfd-120a-4967-945b-ba1786a6af59 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:15.927182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3150bf0-202e-4638-af06-91ce2c5e2960 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:15.942882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:15.943540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.943798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.944038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] PATH_INFO: `/v3/services/network` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.944802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:15.946312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:15.962102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:15.962737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:15.963012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:15.963281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:15.963647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:15.965803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:15.967733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:15.969718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 386/780] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:15 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:15.972959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:15.974406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:15.976062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:15.992076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:15.994359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:15.996428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:15.996428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:15.996428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:15.996428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 395/781] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:15.999184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:16.102800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393e9bd-2fee-478e-9d00-4c08e353ae6c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:16.137199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:16.137814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.138091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.138365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.144940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:16.144940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:16.144940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:16.155606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 396/782] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:16.157292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:16.172412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:16.188509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954da2d-a9df-4a0b-a2eb-2840073e853c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:16.225492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:16.226798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.227267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.227713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.228505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:16.228996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:16.230581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:16.236556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 387/783] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:16.243683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:16.296938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:16.382950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95212cc6-a342-44b2-8eed-274279fbbc3f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:16.397046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0d452-8eb0-4862-9bb2-04a04bcb09c9 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:16.427509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:16.428171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.428455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.428788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.430028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] RBAC: Adding query filter params (type=network) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:16.430422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:16.431804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:16.437108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 388/784] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:16.442721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:16.448125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:16.448773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.449079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.449351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] PATH_INFO: `/v3/users/swift` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.463261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:16.464800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:16.477919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:16.478906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:16.479892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 397/785] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:16.486968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:16.541748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:16.580740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:16.592238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ec9d2-4fc2-4b34-af6f-d98bc31d6a89 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:16.603912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ad012-ddec-479c-bb90-14374cc85a4e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:16.628952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4874b4-189e-480b-a8aa-9d55ccc474ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:16.629907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4874b4-189e-480b-a8aa-9d55ccc474ad None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.630376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4874b4-189e-480b-a8aa-9d55ccc474ad None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.630863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4874b4-189e-480b-a8aa-9d55ccc474ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.631824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4874b4-189e-480b-a8aa-9d55ccc474ad None admin] RBAC: Adding query filter params (interface=public, service_id=128921f683b542b19b5b9b799ff9b161, region_id=RegionOne) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:16.632357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4874b4-189e-480b-a8aa-9d55ccc474ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:16.634019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4874b4-189e-480b-a8aa-9d55ccc474ad None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:16.644951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d7dc-71f7-40a7-98bf-35818ded00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:16.645381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 389/786] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:37:16 2022] GET /identity/v3/endpoints?service_id=128921f683b542b19b5b9b799ff9b161&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:16.645484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d7dc-71f7-40a7-98bf-35818ded00d8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.645700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d7dc-71f7-40a7-98bf-35818ded00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.645977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d7dc-71f7-40a7-98bf-35818ded00d8 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.646734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d7dc-71f7-40a7-98bf-35818ded00d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:16.647043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d7dc-71f7-40a7-98bf-35818ded00d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:16.648023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890237-c26f-48ed-9cd4-e5b2a3ff98ee None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.648603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890237-c26f-48ed-9cd4-e5b2a3ff98ee None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.648832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d7dc-71f7-40a7-98bf-35818ded00d8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:16.649300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890237-c26f-48ed-9cd4-e5b2a3ff98ee None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.651143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 390/787] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:16.654267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b890237-c26f-48ed-9cd4-e5b2a3ff98ee None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:16.676515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 398/788] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Sep 3 03:37:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:16.682770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2c3f-4cdd-402a-b298-553a315d5877 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.683350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2c3f-4cdd-402a-b298-553a315d5877 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.683854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2c3f-4cdd-402a-b298-553a315d5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.702436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-6dbd2c3f-4cdd-402a-b298-553a315d5877 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:16.703997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6dbd2c3f-4cdd-402a-b298-553a315d5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:16.781100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 399/789] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:16.781100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2c3f-4cdd-402a-b298-553a315d5877 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:16.790860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b890237-c26f-48ed-9cd4-e5b2a3ff98ee None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:16.843492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:16.857890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc354cb7-b0f8-4000-8aad-80706cd2230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:16.858508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354cb7-b0f8-4000-8aad-80706cd2230b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.858789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354cb7-b0f8-4000-8aad-80706cd2230b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.859059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc354cb7-b0f8-4000-8aad-80706cd2230b None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.859670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc354cb7-b0f8-4000-8aad-80706cd2230b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:16.861084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc354cb7-b0f8-4000-8aad-80706cd2230b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:16.869868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 391/790] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:16 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:16.929075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3f33-b631-4f73-a074-a80f3eb5e51b None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.929373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3f33-b631-4f73-a074-a80f3eb5e51b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.929713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e3f33-b631-4f73-a074-a80f3eb5e51b None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.931615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 392/791] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:16.938267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2c34-8d0e-4df9-8f76-c864d56612db None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:16.938566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2c34-8d0e-4df9-8f76-c864d56612db None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:16.938813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be2c34-8d0e-4df9-8f76-c864d56612db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:16.976562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-48be2c34-8d0e-4df9-8f76-c864d56612db None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:16.978342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-48be2c34-8d0e-4df9-8f76-c864d56612db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:17.000676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2c3f-4cdd-402a-b298-553a315d5877 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.011293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:17.044694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.045376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.045832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.046112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.060472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:17.062152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:17.077962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:17.078920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:17.079785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:17.079785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:17.079785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:17.079785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 400/792] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:17.080002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.091016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 393/793] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:17.091886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2c34-8d0e-4df9-8f76-c864d56612db None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.271020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:17.292104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52cb93-a214-4545-b530-1774fcb7cfbc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.345139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.345541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.345827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.346100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.365350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be2c34-8d0e-4df9-8f76-c864d56612db None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.377842 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:17.383296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:17.384191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:17.389472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:17.393037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 401/794] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:17.402552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.410779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.411703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.412230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.412686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.413586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:17.414097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:17.415663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:17.428336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 394/795] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:17.438089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.459310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:17.559764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c38c69-5cc6-4dd9-b237-48ee2400accb None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.576934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462de3e-1c5a-42a5-84e8-d3d424097182 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.596870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.597519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.597802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.598078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.598750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:17.599060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:17.600529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:17.613739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 402/796] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:17.613739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.615141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:17.619417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c2e66-20e9-4161-a18c-c03d390d4af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.620322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c2e66-20e9-4161-a18c-c03d390d4af0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.621212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c2e66-20e9-4161-a18c-c03d390d4af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.621616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c2e66-20e9-4161-a18c-c03d390d4af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.630742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c2e66-20e9-4161-a18c-c03d390d4af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:17.632552 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c2e66-20e9-4161-a18c-c03d390d4af0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-b45c2e66-20e9-4161-a18c-c03d390d4af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:17.648355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:17.649289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:17.650174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 395/797] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:17.651098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86086-22f7-4cfa-9efa-ad0730047e36 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.651098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86086-22f7-4cfa-9efa-ad0730047e36 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.651248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86086-22f7-4cfa-9efa-ad0730047e36 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.656646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 396/798] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:17.656646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86086-22f7-4cfa-9efa-ad0730047e36 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.724894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38149e1c-b7ad-4e50-be62-9f4b558c8d5d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.733354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:17.761677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.762420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.762629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.762900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.767937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86086-22f7-4cfa-9efa-ad0730047e36 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.773570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:17.779009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:17.779915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:17.780745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 403/799] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:17.781468 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.810048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4aaa89-2665-412a-b922-70bc93ab27f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.810991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aaa89-2665-412a-b922-70bc93ab27f1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.811275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aaa89-2665-412a-b922-70bc93ab27f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.811539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4aaa89-2665-412a-b922-70bc93ab27f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.823994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4aaa89-2665-412a-b922-70bc93ab27f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:17.825467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4aaa89-2665-412a-b922-70bc93ab27f1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-db4aaa89-2665-412a-b922-70bc93ab27f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:17.840212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:17.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:17.843008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:17.843008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:17.843008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:17.843008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 397/800] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:17.847133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540321-f0fd-4d5a-8d7a-9b1b9042b2e3 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.847414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540321-f0fd-4d5a-8d7a-9b1b9042b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.847681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540321-f0fd-4d5a-8d7a-9b1b9042b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.858913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:17.866506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e3540321-f0fd-4d5a-8d7a-9b1b9042b2e3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:17.867698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e3540321-f0fd-4d5a-8d7a-9b1b9042b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:17.901057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac7bea-1637-422b-a115-76357a467458 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:17.937134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 398/801] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:17.937544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:17.938240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:17.938529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:17.938810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:17.939146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540321-f0fd-4d5a-8d7a-9b1b9042b2e3 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:17.939514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:17.939980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:17.941464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:17.960182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 404/802] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:17.961533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.006113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:18.056151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540321-f0fd-4d5a-8d7a-9b1b9042b2e3 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.094609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.095139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.095419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.095706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.096353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:18.096656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.098137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.098819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec78bae-7eed-46c9-90af-26d5f9afbdf7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.111814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 399/803] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:18.111814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.136046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:18.163545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.164140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.164494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.165146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.165889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:18.166258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.168446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.185553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 405/804] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:18.186833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.237980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec334a-0796-4e9e-9b2b-ee18f36e184e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.252977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:18.274255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.274913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.275191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.275463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/fe8b2e7f400346f3bcfdedeed017e6ee/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.277372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=fe8b2e7f400346f3bcfdedeed017e6ee, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.278794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.293395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 400/805] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:37:18 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/fe8b2e7f400346f3bcfdedeed017e6ee/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:37:18.294541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.319912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857338ac-ea6c-49e7-b8a8-849bc808dac8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.363071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.363786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.364340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.364494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.377792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.379488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:18.396094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:18.397122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:18.398040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:18.398040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:18.398040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:18.402756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 406/806] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:18.403800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.433418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780bc2e-256a-4eaf-b2a3-49e477e055fe None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.447867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:18.477845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.478835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.478835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.479160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.488040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.489550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:18.506898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:18.507980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:18.509001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:18.510181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 401/807] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:18.511968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.534230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180e67f-d9d7-4090-8a07-9f0e4126d52c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.557370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:18.581577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.582224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.582534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.582777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.583373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.585510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:18.598057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:18.599078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 03:37:18.599888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:18.604242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 407/808] 10.222.0.13 () {56 vars in 1129 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:18.605425 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.654996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89309c-7955-4628-af44-661c656e1ed2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.692110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.692946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.693144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.693468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.694039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:18.694677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.696009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.713114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 402/809] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:18.714032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.714530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c828d6-fdf7-4bfe-8921-2cc6d256edf5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.716323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:18.754847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.755913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.756385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.756900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.757865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:18.758356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.760014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.782386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 408/810] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:18.783777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.822689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:18.826880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a485f-5c5d-4129-94c6-14bba79202b0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.865320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.866051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.866382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.866708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.867351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:18.867656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.869117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.874280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 403/811] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:18.879560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.911608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a358d-b827-4173-8d77-0a28ca212797 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.946653 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:18.947292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:18.947577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:18.947850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:18.955081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:18.956546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:18.968708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:18.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:18.970765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:18.974333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 409/812] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:18.975249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:18.996001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f2369-f904-4266-9380-cf64afe5c107 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:18.996223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.045682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b1835-132d-4145-92de-3160f39a8844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.046556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b1835-132d-4145-92de-3160f39a8844 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.046835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b1835-132d-4145-92de-3160f39a8844 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.047380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b1835-132d-4145-92de-3160f39a8844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.077322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.083245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3716e-68d4-4ae7-9302-954950322ceb None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.120447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ecdcb-7b86-4052-8611-3a3a8289a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.121118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b1835-132d-4145-92de-3160f39a8844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.121202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ecdcb-7b86-4052-8611-3a3a8289a634 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.121438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ecdcb-7b86-4052-8611-3a3a8289a634 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.121628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ecdcb-7b86-4052-8611-3a3a8289a634 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.122259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ecdcb-7b86-4052-8611-3a3a8289a634 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:19.122409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b1835-132d-4145-92de-3160f39a8844 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.122562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ecdcb-7b86-4052-8611-3a3a8289a634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.123916 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ecdcb-7b86-4052-8611-3a3a8289a634 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.136980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 410/813] 10.222.0.13 () {56 vars in 1124 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:19.136980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b3898-b67b-47ba-9b7b-2cbf8b04ea18 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.136980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b3898-b67b-47ba-9b7b-2cbf8b04ea18 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.136980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b3898-b67b-47ba-9b7b-2cbf8b04ea18 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.136980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 411/814] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:19.136980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b3898-b67b-47ba-9b7b-2cbf8b04ea18 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.227217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 404/815] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:19.228578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe112-5382-4ae9-8b32-d36c28e53c88 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.228937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe112-5382-4ae9-8b32-d36c28e53c88 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.229282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe112-5382-4ae9-8b32-d36c28e53c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.251383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.252524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f7cbe112-5382-4ae9-8b32-d36c28e53c88 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:19.254016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f7cbe112-5382-4ae9-8b32-d36c28e53c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:19.272179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b3898-b67b-47ba-9b7b-2cbf8b04ea18 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.306949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.307560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.307837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.308105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.308838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:19.309181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.310036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.310607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.328668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 412/816] 10.222.0.13 () {56 vars in 1149 bytes} [Sat Sep 3 03:37:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:19.329334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 405/817] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:19.329506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.330432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe112-5382-4ae9-8b32-d36c28e53c88 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.460720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe112-5382-4ae9-8b32-d36c28e53c88 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.479264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2cff9-25f8-4098-8041-5624293b0d86 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.509053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.509827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.510164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.510520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.520942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.522743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.525894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.526702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.527184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.527646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.528508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.530566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:19.538088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:19.539032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:19.539934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:19.539934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:19.539934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:19.539934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 406/818] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:19.540849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.547110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.566746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 413/819] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:19.568625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.607794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.709599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950287cb-5baa-4138-a365-e8259426f330 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.750262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2e07d-c91d-4eff-a98d-5e8b473be7f2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.759628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.760274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.760554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.760825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.772757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.774343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:19.792206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:19.793450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:19.794612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:19.794612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:19.794612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:19.794612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 407/820] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:19.794612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.805575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.806451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.806875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.807286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.808083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:19.808540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.810122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.825025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 414/821] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:19.826292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.887311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.917609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:19.929652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a76a65-e317-46f7-a855-1ecb6a213bb5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.944518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a38b53-dfeb-4235-8310-a19b743fc980 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:19.968947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.969878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.970323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.970789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.971546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.973148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:19.982455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:19.983463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 03:37:19.984300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:19.987429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 408/822] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:19 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:19.987533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:19.988054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:19.988435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:19.988717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:19.989177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:19.989411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:19.989718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:19.991295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.009071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 415/823] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:20.010205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.100939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd821b3-ebac-4d96-a3ec-4ad9445bc7c4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.133994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.134629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.134904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.135171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.138466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12db3fd-100e-4f2a-a13f-bd5866002304 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.142094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.143596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.152578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:20.155701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:20.156817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:20.157934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 409/824] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:20.158456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.177903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:20.183948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.184703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.185266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.185639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.186450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:20.186767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.188263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.197974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 416/825] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:20.197974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.269083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60350cc-8a4c-4e13-afba-6adf8cd2032d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.300043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2347f-a04a-4f3e-bffb-b3766e9896c6 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.304583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.305245 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.305529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.305799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.312932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.314374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:20.326565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:20.327471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:20.328349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 410/826] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:20.329757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.340623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6623e-dc32-4840-9fce-15ff0f51685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.341242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6623e-dc32-4840-9fce-15ff0f51685a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.341571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6623e-dc32-4840-9fce-15ff0f51685a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.341792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6623e-dc32-4840-9fce-15ff0f51685a None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.342519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6623e-dc32-4840-9fce-15ff0f51685a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:20.342812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6623e-dc32-4840-9fce-15ff0f51685a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.344251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6623e-dc32-4840-9fce-15ff0f51685a None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.356881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 417/827] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:20.358207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67337-b190-4e53-90f6-d236ed3e5d5f None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.358492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67337-b190-4e53-90f6-d236ed3e5d5f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.358757 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67337-b190-4e53-90f6-d236ed3e5d5f None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.364518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 418/828] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:20.364518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67337-b190-4e53-90f6-d236ed3e5d5f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.397351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:20.419563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:20.445533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14a249-7d11-43aa-92da-58cdca3521f9 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.466271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67337-b190-4e53-90f6-d236ed3e5d5f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.482939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.483538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.483820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.484081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.484704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] RBAC: Adding query filter params (type=network) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:20.485031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.486713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.492158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 411/829] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:20.497322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.505705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce552f-28e2-487f-b6a3-a67140d01f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.507245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce552f-28e2-487f-b6a3-a67140d01f0e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.507529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce552f-28e2-487f-b6a3-a67140d01f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.507802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce552f-28e2-487f-b6a3-a67140d01f0e None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.508867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce552f-28e2-487f-b6a3-a67140d01f0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:20.509229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce552f-28e2-487f-b6a3-a67140d01f0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.511073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce552f-28e2-487f-b6a3-a67140d01f0e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.527829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 419/830] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:20.527829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488487f9-51fd-48a2-af92-0f2d388c0832 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.527829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488487f9-51fd-48a2-af92-0f2d388c0832 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.527829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488487f9-51fd-48a2-af92-0f2d388c0832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.544401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-488487f9-51fd-48a2-af92-0f2d388c0832 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:20.545633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-488487f9-51fd-48a2-af92-0f2d388c0832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:20.612021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bd428-51ac-42fe-8402-0eceec6e203c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.620610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 420/831] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:20.621320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488487f9-51fd-48a2-af92-0f2d388c0832 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.647119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.647768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.648044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.648313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.649056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=b74a8d0579ba402c8f64fa7a6bb24658) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:20.649360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.650779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.664967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 412/832] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:20 2022] GET /identity/v3/role_assignments?user.id=b74a8d0579ba402c8f64fa7a6bb24658&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:20.664967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.670109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:20.674398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:20.821066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488487f9-51fd-48a2-af92-0f2d388c0832 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.866513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d07bc-57ec-43cb-b13c-ab2edfd6b6da None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:20.877363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.878294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.878785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.879267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.880135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.881903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.903201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:20.903860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:20.904136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:20.904406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f0cdc86ba2a84930b1252299feab9913/roles/1b9d5a0d48404d25866dbae57a2f8ef1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:20.905164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 421/833] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:20 2022] POST /identity/v3/endpoints => generated 337 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:20.906032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:20.928702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=f0cdc86ba2a84930b1252299feab9913, role_id=1b9d5a0d48404d25866dbae57a2f8ef1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:20.930349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:20.953085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 413/834] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:37:20 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f0cdc86ba2a84930b1252299feab9913/roles/1b9d5a0d48404d25866dbae57a2f8ef1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:37:21.019666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:21.052950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b7306-1e4c-4f51-9a8b-3405dc27ac3d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:21.093511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:21.094077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.094352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.094620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.107288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:21.113091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:21.114031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:21.115007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 422/835] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:21.122573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:21.186490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:21.235535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc724b-2240-48ec-ade3-5c4e33412269 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:21.277544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:21.278253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.278537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.278804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.279469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:21.279765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:21.281177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:21.290338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 414/836] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:21.296612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:21.424613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6563b-b6f1-4635-8669-ce8e6aaf14e8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:21.461494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96364e77-c484-4b72-9720-349e80a9ef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:21.462135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364e77-c484-4b72-9720-349e80a9ef78 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.462415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364e77-c484-4b72-9720-349e80a9ef78 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.462686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364e77-c484-4b72-9720-349e80a9ef78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.469965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:21.475048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96364e77-c484-4b72-9720-349e80a9ef78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:21.476577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96364e77-c484-4b72-9720-349e80a9ef78 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-96364e77-c484-4b72-9720-349e80a9ef78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:21.491745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:21.492803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:21.493912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:21.493912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:21.493912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:21.493912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 423/837] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:21.500314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:21.601116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92288964-7dbf-48e6-a85a-4bf68ddc8e04 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:21.618274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:21.635973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c34656-2ae5-42be-a90c-df344ea44578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:21.636596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c34656-2ae5-42be-a90c-df344ea44578 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.636850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c34656-2ae5-42be-a90c-df344ea44578 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.637151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c34656-2ae5-42be-a90c-df344ea44578 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.637793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c34656-2ae5-42be-a90c-df344ea44578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:21.638092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c34656-2ae5-42be-a90c-df344ea44578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:21.639459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c34656-2ae5-42be-a90c-df344ea44578 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:21.650494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab13ef8-0ccb-4bee-85c2-bfd48145cefc None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.650780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab13ef8-0ccb-4bee-85c2-bfd48145cefc None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.651057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab13ef8-0ccb-4bee-85c2-bfd48145cefc None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.651951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 415/838] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:21.652385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 424/839] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:21.657633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783ace4-27f4-4452-b219-9edb9d911595 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.657751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab13ef8-0ccb-4bee-85c2-bfd48145cefc None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:21.657914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783ace4-27f4-4452-b219-9edb9d911595 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.658186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783ace4-27f4-4452-b219-9edb9d911595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.675516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4783ace4-27f4-4452-b219-9edb9d911595 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:21.676628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4783ace4-27f4-4452-b219-9edb9d911595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:21.749253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 416/840] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:21.767383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab13ef8-0ccb-4bee-85c2-bfd48145cefc None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:21.801500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:21.802352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.802781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.803197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.811100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:21.812703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:21.823965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:21.825086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 03 03:37:21.826231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:21.828408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 425/841] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:21.834112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783ace4-27f4-4452-b219-9edb9d911595 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:21.937230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783ace4-27f4-4452-b219-9edb9d911595 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:21.945591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:21.976480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:21.977126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:21.977409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:21.977680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:21.978411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:21.978714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:21.980209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:21.999734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 417/842] 10.222.0.13 () {56 vars in 1135 bytes} [Sat Sep 3 03:37:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:22.005444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:22.046451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:22.058651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:22.138876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be191776-8fa7-4a47-a095-2f99fd8c7305 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:22.168179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a5a76-2444-4cd0-b27c-b3505748e732 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:22.191389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:22.191933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.192461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.192735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.203029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:22.203914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.204286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.204648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.205363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:22.206964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:22.216463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:22.218268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:22.219726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 418/843] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:22.224563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:22.266347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:22.276240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:22.277416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:22.330527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:22.362647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a3651-76a5-4363-b0b3-e4c1be55bda1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:22.387221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 426/844] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:22.396936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:22.403917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:22.404537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.404817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.405125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.405755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:22.406054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:22.407422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:22.412443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 419/845] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:22.417766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:22.522695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:22.534705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bb5fc-2a39-440b-8985-ab19efe8cbbb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:22.573441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:22.574747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.575033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.575303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.575943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:22.576242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:22.578138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:22.588950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 420/846] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:22.657435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85472af-816b-4b4c-95b1-a97f5623e92f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:22.695876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa2de5-f859-4346-b1bd-74d1ce7a5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:22.696526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2de5-f859-4346-b1bd-74d1ce7a5e42 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.696800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2de5-f859-4346-b1bd-74d1ce7a5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.697099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2de5-f859-4346-b1bd-74d1ce7a5e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.708654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2de5-f859-4346-b1bd-74d1ce7a5e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:22.710211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2de5-f859-4346-b1bd-74d1ce7a5e42 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4baa2de5-f859-4346-b1bd-74d1ce7a5e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:22.727651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:22.728660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:22.729568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:22.729568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:22.729568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:22.729568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 427/847] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:22.733786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:22.855070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371346c6-37be-4488-a764-cc1b5bf30f95 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:22.891381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:22.891997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.892282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.892557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.893248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:22.893556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:22.894927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:22.909017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 421/848] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:22.914064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de44f4-a7f7-4a0b-8de0-cd2fcaa684f3 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.914352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de44f4-a7f7-4a0b-8de0-cd2fcaa684f3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.914457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:22.914618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de44f4-a7f7-4a0b-8de0-cd2fcaa684f3 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.916250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 428/849] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:22.923392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654720f6-b49f-44b3-b720-1db3f7ece57f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:22.923793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654720f6-b49f-44b3-b720-1db3f7ece57f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:22.924162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654720f6-b49f-44b3-b720-1db3f7ece57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:22.940529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:22.946688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-654720f6-b49f-44b3-b720-1db3f7ece57f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:22.948409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-654720f6-b49f-44b3-b720-1db3f7ece57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:22.953207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:23.030758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 429/850] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:23.038404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35086335-e418-4c2e-bcf8-35ec35afde6d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.074316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d3b5d-6d88-438f-8db6-1fbb16a3d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.074966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3b5d-6d88-438f-8db6-1fbb16a3d20f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.075252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3b5d-6d88-438f-8db6-1fbb16a3d20f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.075528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d3b5d-6d88-438f-8db6-1fbb16a3d20f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.082641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d3b5d-6d88-438f-8db6-1fbb16a3d20f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:23.084103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d3b5d-6d88-438f-8db6-1fbb16a3d20f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-fa7d3b5d-6d88-438f-8db6-1fbb16a3d20f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:23.096749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:23.097697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:23.098563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 422/851] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:23.106139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654720f6-b49f-44b3-b720-1db3f7ece57f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:23.117631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855d88-e824-43d0-b70e-9e86dd4a7f4d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.117980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855d88-e824-43d0-b70e-9e86dd4a7f4d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.118254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62855d88-e824-43d0-b70e-9e86dd4a7f4d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.120347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 423/852] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:23.126315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666482-8530-4d1c-bd2d-cdddb19f7246 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.126601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666482-8530-4d1c-bd2d-cdddb19f7246 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.126874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666482-8530-4d1c-bd2d-cdddb19f7246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.146121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-44666482-8530-4d1c-bd2d-cdddb19f7246 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:23.147485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-44666482-8530-4d1c-bd2d-cdddb19f7246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:23.229706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654720f6-b49f-44b3-b720-1db3f7ece57f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.248938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 424/853] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:23.264454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:23.271661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.272366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.272648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.272937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.273649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:23.273956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:23.275466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:23.288652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 430/854] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:23.294767 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44666482-8530-4d1c-bd2d-cdddb19f7246 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:23.303684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:23.318900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:23.409030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44666482-8530-4d1c-bd2d-cdddb19f7246 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.422521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf497b-7dac-4ce2-b687-9d42d0259f0a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.446274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.446980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.447264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.447534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.448260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=fe8b2e7f400346f3bcfdedeed017e6ee) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:23.448563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:23.450287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:23.456843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 425/855] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/role_assignments?user.id=fe8b2e7f400346f3bcfdedeed017e6ee&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:23.457444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.458193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.458479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.458753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.459338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:23.461099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:23.471111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:23.473318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:23.475585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:23.481036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 431/856] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:23.481234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:23.544802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:23.558822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:23.604262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2397-f1fc-4063-9adc-a44d98ba0eb9 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.624718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:23.653120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.654154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.654441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.654712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.655686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:23.656010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:23.658186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:23.665020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 426/857] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:23.670531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:23.685935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7960af-4b60-4eeb-958d-71d2db0c9e5d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.729115 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.740696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.740696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.740696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.756656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:23.761667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:23.762622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:23.763710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 432/858] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:23.768514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:23.798350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b684c-0f2d-481f-9019-b5754d5e5699 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.835805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.836870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.837441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.837918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.838768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:23.839289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:23.841026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:23.842645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:23.853088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 427/859] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:23.893562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72375d8-44d2-4269-ab12-8b17281ab8ac None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:23.913895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:23.934549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:23.935163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:23.935447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:23.935721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:23.936407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:23.936718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:23.938154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:23.947941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 433/860] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:23.953645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:24.061884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3e7f-eac6-498f-97f8-2888d0b7d0a2 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:24.096807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:24.097488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:24.097790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:24.098051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:24.109205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:24.110691 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:24.125297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:24.126248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:24.128317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:24.128317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:24.128317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:24.128317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 428/861] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:24.132942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:24.240720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96982e07-9e03-452c-a99b-d8c23b34eb4a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:24.276366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:24.277005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:24.277289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:24.277564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:24.278275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:24.278586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:24.279963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:24.292495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 434/862] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:24.298182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:24.350206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:24.401770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241a4d3-9f23-4ab8-8cdc-c3849454c0ef None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:24.436150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae4844-ebbf-45ff-addd-b235e26fd801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:24.436787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4844-ebbf-45ff-addd-b235e26fd801 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:24.437103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4844-ebbf-45ff-addd-b235e26fd801 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:24.437378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae4844-ebbf-45ff-addd-b235e26fd801 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:24.445425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae4844-ebbf-45ff-addd-b235e26fd801 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:24.446868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae4844-ebbf-45ff-addd-b235e26fd801 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-2dae4844-ebbf-45ff-addd-b235e26fd801 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:24.458167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:24.459106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:24.460382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 429/863] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:37:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:24.466247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:24.508082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:24.570461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf9b7f-1388-4eff-ac9a-93fea479e9f3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:24.597379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289156d4-d045-4a25-bd38-ecffbbf8d69c None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:24.598020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289156d4-d045-4a25-bd38-ecffbbf8d69c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:24.598498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289156d4-d045-4a25-bd38-ecffbbf8d69c None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:24.600336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 430/864] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:24.605689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782cb4-5d24-4ad9-aa9d-2313a1fed563 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:24.606216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782cb4-5d24-4ad9-aa9d-2313a1fed563 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:24.606494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:24.606969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782cb4-5d24-4ad9-aa9d-2313a1fed563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:24.607143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:24.607388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:24.607660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:24.608389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:24.608694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:24.610224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:24.628185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d0782cb4-5d24-4ad9-aa9d-2313a1fed563 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:24.629890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d0782cb4-5d24-4ad9-aa9d-2313a1fed563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:24.634474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 435/865] 10.222.0.13 () {56 vars in 1149 bytes} [Sat Sep 3 03:37:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:24.640297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:24.709151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 431/866] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:24.753091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:24.759969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0d01c-2a90-443c-abfb-d377af231a5c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:24.794599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:24.795558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:24.796046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:24.796522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:24.868484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:24.870379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:24.970872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782cb4-5d24-4ad9-aa9d-2313a1fed563 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:24.974854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:24.982043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 436/867] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:24.990712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:25.018867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:25.090986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782cb4-5d24-4ad9-aa9d-2313a1fed563 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:25.113094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7753-2c10-4a38-afc4-8562920e9d87 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:25.133240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:25.133853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.134129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.134399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.135052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:25.136862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:25.152563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:25.153594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.159369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.159541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 432/868] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:24 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:37:25.159623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.173003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:25.173003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:25.189982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:25.190994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:25.191898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:25.191898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:25.191898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:25.191898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 437/869] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:25.197578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:25.316419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:25.334106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27c47b-2bbd-4bfe-a0c9-dde939e3e575 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:25.375246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe73a5a-95e1-4f59-9c4d-9aad1c3d79ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:25.375878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73a5a-95e1-4f59-9c4d-9aad1c3d79ae None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.376162 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73a5a-95e1-4f59-9c4d-9aad1c3d79ae None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.376435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe73a5a-95e1-4f59-9c4d-9aad1c3d79ae None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.377165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73a5a-95e1-4f59-9c4d-9aad1c3d79ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:25.377475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73a5a-95e1-4f59-9c4d-9aad1c3d79ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:25.378912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe73a5a-95e1-4f59-9c4d-9aad1c3d79ae None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:25.391484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 433/870] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:25.397296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:25.453841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:25.506678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b967fb-1ecd-412e-9533-51944b5c53f8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:25.540015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65766108-f2fc-4a07-88fb-55a74b1c4cea None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.540297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65766108-f2fc-4a07-88fb-55a74b1c4cea None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.540584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65766108-f2fc-4a07-88fb-55a74b1c4cea None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.542214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 434/871] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:25.542626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:25.543551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.543996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.544467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.547080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1a44-ff4a-44d3-b813-7cfdd8abab39 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.547362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1a44-ff4a-44d3-b813-7cfdd8abab39 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.547632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1a44-ff4a-44d3-b813-7cfdd8abab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.554879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:25.556418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:25.566143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6d8f1a44-ff4a-44d3-b813-7cfdd8abab39 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:25.567644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6d8f1a44-ff4a-44d3-b813-7cfdd8abab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:25.568429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:25.569406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:25.570460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 438/872] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:25.576590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:25.668958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 435/873] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:25.700113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc889e-736e-4898-b120-99341b7daa4f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:25.709603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:25.735799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d20e-91a2-441d-8d31-a7bac2cfc96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:25.736717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d20e-91a2-441d-8d31-a7bac2cfc96b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.737043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d20e-91a2-441d-8d31-a7bac2cfc96b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.737323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d20e-91a2-441d-8d31-a7bac2cfc96b None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.738021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d20e-91a2-441d-8d31-a7bac2cfc96b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:25.738329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d20e-91a2-441d-8d31-a7bac2cfc96b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:25.739775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d20e-91a2-441d-8d31-a7bac2cfc96b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:25.752586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 439/874] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:25.762043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1a44-ff4a-44d3-b813-7cfdd8abab39 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:25.854450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97aa1-92f6-4417-b4c0-9e90ea966969 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.854637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97aa1-92f6-4417-b4c0-9e90ea966969 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.854905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97aa1-92f6-4417-b4c0-9e90ea966969 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.856382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 440/875] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:25.856870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:25.862929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c53dd-2f15-4677-8030-95f3c0363c49 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.864316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c53dd-2f15-4677-8030-95f3c0363c49 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.864803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c53dd-2f15-4677-8030-95f3c0363c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.876424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1a44-ff4a-44d3-b813-7cfdd8abab39 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:25.885828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-665c53dd-2f15-4677-8030-95f3c0363c49 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:25.887372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-665c53dd-2f15-4677-8030-95f3c0363c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:25.912494 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:25.913245 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:25.913530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:25.913810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:25.914692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f0cdc86ba2a84930b1252299feab9913) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:25.915005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:25.916450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:25.923302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 436/876] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:25 2022] GET /identity/v3/role_assignments?user.id=f0cdc86ba2a84930b1252299feab9913&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:25.926280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:25.966072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 441/877] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:26.035477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b11af-e206-42fa-a118-3eb78a3d2094 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:26.071925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:26.072563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:26.072840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:26.073139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:26.073721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:26.075085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:26.084232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:26.085331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:26.086168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 437/878] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:26.091674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c53dd-2f15-4677-8030-95f3c0363c49 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:26.197261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:26.201536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c53dd-2f15-4677-8030-95f3c0363c49 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:26.236493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:26.237130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:26.237406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:26.237670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:26.238297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:26.238590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:26.239946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:26.245060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 442/879] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:26.250534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:26.255817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:26.268103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:26.358567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7128-d42e-4a9b-9a82-fb5a87a20455 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:26.393904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85852d99-40fd-4ea9-b959-22edb66822df None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:26.402523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d537d3-f61f-4b83-8d89-ea11714b9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:26.403677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d537d3-f61f-4b83-8d89-ea11714b9c22 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:26.403962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d537d3-f61f-4b83-8d89-ea11714b9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:26.404238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d537d3-f61f-4b83-8d89-ea11714b9c22 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:26.404877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d537d3-f61f-4b83-8d89-ea11714b9c22 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:26.405226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d537d3-f61f-4b83-8d89-ea11714b9c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:26.407070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d537d3-f61f-4b83-8d89-ea11714b9c22 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:26.417157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 438/880] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:26.439194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5075d5-86b0-4ac0-b834-8a5dc9272bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:26.440273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5075d5-86b0-4ac0-b834-8a5dc9272bea None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:26.440740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5075d5-86b0-4ac0-b834-8a5dc9272bea None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:26.441349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5075d5-86b0-4ac0-b834-8a5dc9272bea None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:26.442180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5075d5-86b0-4ac0-b834-8a5dc9272bea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:26.443849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5075d5-86b0-4ac0-b834-8a5dc9272bea None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:26.465072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 443/881] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:26 2022] POST /identity/v3/services => generated 269 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:27.206567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b602-06b5-4ecf-b69f-999ee6e171a5 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:27.207015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b602-06b5-4ecf-b69f-999ee6e171a5 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:27.207399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b602-06b5-4ecf-b69f-999ee6e171a5 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:27.209160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 439/882] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:27.214499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac09b2-e921-4b03-b301-0ca134156cca None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:27.214977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac09b2-e921-4b03-b301-0ca134156cca None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:27.215058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac09b2-e921-4b03-b301-0ca134156cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:27.233505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-eeac09b2-e921-4b03-b301-0ca134156cca None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:27.234685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-eeac09b2-e921-4b03-b301-0ca134156cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:27.252289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:27.310957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 444/883] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:27.582605 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b602-06b5-4ecf-b69f-999ee6e171a5 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:27.667000 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:27.690666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b602-06b5-4ecf-b69f-999ee6e171a5 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:27.728798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:27.729827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:27.730343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:27.730819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:27.731600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:27.733195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:27.742892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:27.743865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:27.744706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:27.748521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 440/884] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:27.754441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac09b2-e921-4b03-b301-0ca134156cca None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:27.862754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac09b2-e921-4b03-b301-0ca134156cca None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:27.897582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25609bb-1060-4f5c-8f5c-98031ad61c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:27.898450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25609bb-1060-4f5c-8f5c-98031ad61c7c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:27.898731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25609bb-1060-4f5c-8f5c-98031ad61c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:27.899001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25609bb-1060-4f5c-8f5c-98031ad61c7c None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:27.899635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25609bb-1060-4f5c-8f5c-98031ad61c7c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:27.899930 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25609bb-1060-4f5c-8f5c-98031ad61c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:27.901345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25609bb-1060-4f5c-8f5c-98031ad61c7c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:27.906613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 445/885] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:27.912141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:27.936443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509c654-4a07-495c-9afb-421732c988c6 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:27.936800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509c654-4a07-495c-9afb-421732c988c6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:27.937022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509c654-4a07-495c-9afb-421732c988c6 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:27.938481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 446/886] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:27.943666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cace77-2ba7-4687-a12f-dd8dfeb5b926 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:27.944023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cace77-2ba7-4687-a12f-dd8dfeb5b926 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:27.944428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cace77-2ba7-4687-a12f-dd8dfeb5b926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:27.962828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-57cace77-2ba7-4687-a12f-dd8dfeb5b926 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:27.964004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-57cace77-2ba7-4687-a12f-dd8dfeb5b926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:27.997314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:28.023359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cb7ce-b711-4ef4-b5cd-3e3ce912635b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.035362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 447/887] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:28.064813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.065454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.065731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.066002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.066633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:28.066934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:28.068297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:28.074099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 441/888] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:28.079801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cace77-2ba7-4687-a12f-dd8dfeb5b926 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.185653 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cace77-2ba7-4687-a12f-dd8dfeb5b926 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.220654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.221292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.221559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.221831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.222537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] RBAC: Adding query filter params (interface=public, service_id=3975816c3f9f4e12a8990679d8238990, region_id=RegionOne) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:28.222844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:28.224218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:28.234308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 448/889] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:37:28 2022] GET /identity/v3/endpoints?service_id=3975816c3f9f4e12a8990679d8238990&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:28.235711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.246149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:28.299061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.308678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:28.354883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89356fee-c2b0-499b-a509-bf7aeae9fdc1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.400349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8a9a5-92d6-4ac7-8c0a-857795dd5f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.401647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a9a5-92d6-4ac7-8c0a-857795dd5f9d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.402370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a9a5-92d6-4ac7-8c0a-857795dd5f9d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.403242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a9a5-92d6-4ac7-8c0a-857795dd5f9d None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.404323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8a9a5-92d6-4ac7-8c0a-857795dd5f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:28.406574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8a9a5-92d6-4ac7-8c0a-857795dd5f9d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:28.409084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131bbe3-3524-4de1-b6cc-0c0569f86f34 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.414876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 442/890] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:28 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:37:28.416875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9865c-2ff0-4424-9757-c56535fa4a4b None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.417408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9865c-2ff0-4424-9757-c56535fa4a4b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.417888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9865c-2ff0-4424-9757-c56535fa4a4b None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.420596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 443/891] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:28.429467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782d86-ace9-4374-b17d-6efd1dc3a617 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.429467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782d86-ace9-4374-b17d-6efd1dc3a617 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.429467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782d86-ace9-4374-b17d-6efd1dc3a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.447223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-cb782d86-ace9-4374-b17d-6efd1dc3a617 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:28.448704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cb782d86-ace9-4374-b17d-6efd1dc3a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:28.450577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.451237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.451559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.451837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.463684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:28.473433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:28.474429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:28.475438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 449/892] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Sep 3 03:37:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:28.480710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.531589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:28.538281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 444/893] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:28.545125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1fda2-530c-4b31-8735-e69c5b9ed370 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.545125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1fda2-530c-4b31-8735-e69c5b9ed370 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.545125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1fda2-530c-4b31-8735-e69c5b9ed370 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.550178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 445/894] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:28.551541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b9ec-8729-4f49-96eb-d4dc217209b6 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.551828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b9ec-8729-4f49-96eb-d4dc217209b6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.552103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b9ec-8729-4f49-96eb-d4dc217209b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.561190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:28.572792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-43d0b9ec-8729-4f49-96eb-d4dc217209b6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:28.574354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-43d0b9ec-8729-4f49-96eb-d4dc217209b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:28.598874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32c77-0787-4d53-979f-707541ee6f75 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.637566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.638182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.638464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.638736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.639460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:28.639828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:28.641314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:28.649680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 450/895] 10.222.0.13 () {56 vars in 1115 bytes} [Sat Sep 3 03:37:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:28.654983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.657437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 446/896] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:28.759644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4479c6-86e1-4f7a-bba5-172a66c6fc09 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.789895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:28.795077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.795723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.796007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.796285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.807361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:28.808905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:28.812133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b9ec-8729-4f49-96eb-d4dc217209b6 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:28.824021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:28.825224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:28.826118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:28.826118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:28.826118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:28.826118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 451/897] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:28.834327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.927760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b9ec-8729-4f49-96eb-d4dc217209b6 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.947656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce14e4-51d5-4500-b1cb-a54c8b6f1356 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:28.963217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:28.971626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.972236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.972516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.972789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.973467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:28.974835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:28.984069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:28.987776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:28.988294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:28.988808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:28.989729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:28.990234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:28.990432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 447/898] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:28 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:37:28.993093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:28.995950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.016527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 452/899] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:29.022585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.082698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:29.123770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c555-5190-42b1-ad6d-8652759963c5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.162282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc3cef-a226-42a5-8e86-f5108c5d87f7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.164288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.164970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.165264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.165540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.166131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.167526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:29.180568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:29.181815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:29.182863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:29.185547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 448/900] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Sep 3 03:37:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:29.190562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.210156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.210508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.210707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.211269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.222382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.225287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:29.241948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:29.243132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:29.244263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:29.246378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 453/901] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:29.251679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.255248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:29.317700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a48b-2649-4f97-a97a-645544b2a801 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.372389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.373618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.374082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.374781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.375883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:29.376423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:29.377869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.379324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192ccdb-89d3-4193-82cf-3e311cfb59b2 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.379710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.387564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 449/902] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:29.393910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.425002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.425984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.426645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.427082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.428526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:29.429135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.430751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.455455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 454/903] 10.222.0.13 () {56 vars in 1149 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:29.464279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.507305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14843c8-d873-4117-9021-fb69b88b3e33 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.525149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:29.546982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.547831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.548251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.548701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.549369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:29.549674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.551037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.556949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 450/904] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:29.561910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.589204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b5634-5df3-4b42-a4dc-6eb8a2f14665 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.625997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.627011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.627494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.627988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.689339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:29.690863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbb4af-d5be-47cf-9ac4-106333434ea4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.702609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.705291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.729337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.730041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.730229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.730480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.731177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] RBAC: Adding query filter params (interface=public, service_id=28aedd7c2aac4e35b34b56e22b62b2db, region_id=RegionOne) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:29.731482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.732900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.738462 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 451/905] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/endpoints?service_id=28aedd7c2aac4e35b34b56e22b62b2db&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:29.744016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.789007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:29.840065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 455/906] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:29.840902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:29.870720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb8bca-8a28-4de2-b4dc-f735b93e0ca5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.905576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:29.919814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.920782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.921324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:29.921818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:29.922627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:29.924317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:29.931926 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 452/907] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:37:29.958658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cac73-ffa6-44a1-95fb-435a9fe017b7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:29.998440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:29.999481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:29.999970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.000521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.012672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:30.014657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:30.032045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:30.033097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:30.033984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:30.033984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:30.033984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:30.036865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 456/908] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:30.046052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:30.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477a291-45af-45c5-9af6-fc416d647304 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:30.165249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:30.200453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:30.201111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:30.201398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.201675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.202320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:30.202626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:30.204102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:30.216546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 453/909] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:30.221868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:30.326073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083a9ef-1c67-4739-9cd3-686b201e2341 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:30.336577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:30.361018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0dc9-b84d-4456-8d5a-d0d2610dcd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:30.361964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0dc9-b84d-4456-8d5a-d0d2610dcd80 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:30.362240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0dc9-b84d-4456-8d5a-d0d2610dcd80 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.362512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0dc9-b84d-4456-8d5a-d0d2610dcd80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.369362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b0dc9-b84d-4456-8d5a-d0d2610dcd80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:30.370812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b0dc9-b84d-4456-8d5a-d0d2610dcd80 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-f90b0dc9-b84d-4456-8d5a-d0d2610dcd80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:30.382326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:30.383199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:30.384081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 457/910] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:30.389618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:30.451014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd890daa-9e60-479a-9271-943f1c7ca945 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:30.451318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd890daa-9e60-479a-9271-943f1c7ca945 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.451497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd890daa-9e60-479a-9271-943f1c7ca945 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.452953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 458/911] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:30.462629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39639eb7-4485-4cb6-a176-cf4dde756eb1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:30.462909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39639eb7-4485-4cb6-a176-cf4dde756eb1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.463182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39639eb7-4485-4cb6-a176-cf4dde756eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.485206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-39639eb7-4485-4cb6-a176-cf4dde756eb1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:30.487608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-39639eb7-4485-4cb6-a176-cf4dde756eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:30.508211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85fa4a-9336-4c37-bc40-62217156057a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:30.551132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:30.552100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:30.552601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.553139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.554041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:30.554540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:30.556212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:30.568978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 454/912] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:30.575218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:30.577133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 459/913] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:30.608087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:30.684197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa20f-03a3-4575-944b-8d269aa14f47 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:30.720207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0d191-b0f8-459d-91d2-a94d0bc70ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:30.720817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d191-b0f8-459d-91d2-a94d0bc70ede None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:30.721090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d191-b0f8-459d-91d2-a94d0bc70ede None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.721300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d191-b0f8-459d-91d2-a94d0bc70ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.722017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d191-b0f8-459d-91d2-a94d0bc70ede None admin] RBAC: Adding query filter params (role.id=60fc0b3d025240d8ab843778145cd94e, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f0cdc86ba2a84930b1252299feab9913) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:30.722323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d191-b0f8-459d-91d2-a94d0bc70ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:30.723742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d191-b0f8-459d-91d2-a94d0bc70ede None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:30.729856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 455/914] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:30 2022] GET /identity/v3/role_assignments?user.id=f0cdc86ba2a84930b1252299feab9913&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=60fc0b3d025240d8ab843778145cd94e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:30.856554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39639eb7-4485-4cb6-a176-cf4dde756eb1 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:30.962655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:30.965908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39639eb7-4485-4cb6-a176-cf4dde756eb1 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:30.995103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f31c-a3e9-4fd7-9bb9-28872906c529 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:30.995404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f31c-a3e9-4fd7-9bb9-28872906c529 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:30.995572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f31c-a3e9-4fd7-9bb9-28872906c529 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:30.998281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 456/915] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:31.002170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:31.002330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309dbcf-82ea-4d48-b73a-f880e9aa1fc6 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.002538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309dbcf-82ea-4d48-b73a-f880e9aa1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.002801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309dbcf-82ea-4d48-b73a-f880e9aa1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.002897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.003074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.003336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.003969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:31.005384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:31.016961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:31.017977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:31.018795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 460/916] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:31.024465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:31.024670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f309dbcf-82ea-4d48-b73a-f880e9aa1fc6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:31.026010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f309dbcf-82ea-4d48-b73a-f880e9aa1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:31.117526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 457/917] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:31.144624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cc78f-644b-4b12-91e7-c07781c8bee6 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:31.180011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:31.180632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.180929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.181219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.181859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:31.182163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:31.183538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:31.188805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 461/918] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:31.194542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309dbcf-82ea-4d48-b73a-f880e9aa1fc6 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:31.216703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:31.296771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309dbcf-82ea-4d48-b73a-f880e9aa1fc6 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:31.331411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:31.332033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.332317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.332591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.333251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:31.333555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:31.335204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:31.340546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 458/919] 10.222.0.13 () {56 vars in 1114 bytes} [Sat Sep 3 03:37:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:31.346250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:31.383796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:31.395983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:31.471241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66458a6-49f6-42e3-bb4e-6d8745e9d5f9 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:31.491455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:31.508457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:31.509420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.509898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.510360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.511287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:31.512011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b5731-21b1-484d-8318-d2836d5f8429 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:31.513091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:31.538375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 462/920] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:31.571195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:31.572255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.572736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.573315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.574113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:31.575807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:31.587612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:31.588686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:31.589558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:31.597155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 459/921] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:31.599831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:31.698399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:31.717026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a8507-a400-4e9d-b4e4-28657b1b39e0 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:31.752861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be745958-e647-4b64-9a0d-7947542da085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:31.753847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745958-e647-4b64-9a0d-7947542da085 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.754342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745958-e647-4b64-9a0d-7947542da085 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.754829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be745958-e647-4b64-9a0d-7947542da085 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.755660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745958-e647-4b64-9a0d-7947542da085 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:31.756158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745958-e647-4b64-9a0d-7947542da085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:31.757853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be745958-e647-4b64-9a0d-7947542da085 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:31.768025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 463/922] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:31.769774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:31.879975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff30683-598b-4f33-856b-9f94e0f394e3 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:31.916602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:31.918043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.918527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.919017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.919138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd60b-ef6c-4c1f-b6a4-35e824ca4c72 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.919364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd60b-ef6c-4c1f-b6a4-35e824ca4c72 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.919644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd60b-ef6c-4c1f-b6a4-35e824ca4c72 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.920406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:31.921014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:31.921271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 464/923] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:31.922956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:31.926306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34d79-3036-4da4-bfa0-1173a235f818 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:31.926587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34d79-3036-4da4-bfa0-1173a235f818 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:31.926858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34d79-3036-4da4-bfa0-1173a235f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:31.933916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 460/924] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:31.937868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:31.945989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b5a34d79-3036-4da4-bfa0-1173a235f818 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:31.947188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b5a34d79-3036-4da4-bfa0-1173a235f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:31.950193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:32.020248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 465/925] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:32.043468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e8700-56c0-4253-9553-0346d484a864 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:32.078646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:32.079595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.080102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.080571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.081521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] RBAC: Adding query filter params (interface=public, service_id=8393cadf44fa43829ed52a5e968c4406, region_id=RegionOne) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:32.082030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:32.083590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:32.094049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 461/926] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:37:31 2022] GET /identity/v3/endpoints?service_id=8393cadf44fa43829ed52a5e968c4406&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:32.095770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34d79-3036-4da4-bfa0-1173a235f818 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:32.183577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:32.208198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34d79-3036-4da4-bfa0-1173a235f818 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:32.243366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820252b-7084-400f-be11-af6caed23528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:32.243974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820252b-7084-400f-be11-af6caed23528 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.244251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820252b-7084-400f-be11-af6caed23528 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.244523 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820252b-7084-400f-be11-af6caed23528 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.245153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820252b-7084-400f-be11-af6caed23528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:32.246525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820252b-7084-400f-be11-af6caed23528 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:32.252844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 466/927] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:32 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:37:32.284072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:32.360343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:32.394832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41984eae-fff8-413a-84a7-fc223468b8cc None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:32.433537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:32.434104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.434388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.434664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.435251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:32.436684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:32.446149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:32.447070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:32.448598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 462/928] 10.222.0.13 () {56 vars in 1132 bytes} [Sat Sep 3 03:37:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:32.453207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820252b-7084-400f-be11-af6caed23528 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:32.557705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820252b-7084-400f-be11-af6caed23528 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:32.594833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b851-738c-4307-a49a-784de6d52ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:32.595515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b851-738c-4307-a49a-784de6d52ad1 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.595798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b851-738c-4307-a49a-784de6d52ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.596067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b851-738c-4307-a49a-784de6d52ad1 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.596710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b851-738c-4307-a49a-784de6d52ad1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:32.597055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b851-738c-4307-a49a-784de6d52ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:32.598445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6b851-738c-4307-a49a-784de6d52ad1 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:32.603945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 467/929] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:32.610360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:32.722361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc3f81-f991-4b65-92c2-42f84ea08565 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:32.756883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6052e-55d3-4013-9a62-7d754ab5aea2 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.757248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6052e-55d3-4013-9a62-7d754ab5aea2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.757518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6052e-55d3-4013-9a62-7d754ab5aea2 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.758519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:32.759088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 468/930] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:32.759666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.760203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.760680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.761620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:32.762119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:32.763756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:32.764243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c6c5-cc3f-4622-bb10-574dbcb56d5a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.764533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c6c5-cc3f-4622-bb10-574dbcb56d5a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.764940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c6c5-cc3f-4622-bb10-574dbcb56d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.767032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:32.771866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 463/931] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:32.777975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:32.782654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:32.789046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4ce2c6c5-cc3f-4622-bb10-574dbcb56d5a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:32.790228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4ce2c6c5-cc3f-4622-bb10-574dbcb56d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:32.877161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 469/932] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:32.907555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbc22-3245-4a2a-b87d-2bb2b576e1b3 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:32.943401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:32.944407 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:32.944847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:32.945314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:32.946141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:32.947670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:32.974683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 464/933] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:33.152844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c6c5-cc3f-4622-bb10-574dbcb56d5a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:33.262273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c6c5-cc3f-4622-bb10-574dbcb56d5a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:33.298414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:33.303966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:33.304934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:33.305428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:33.305898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:33.316526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:33.321771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:33.322758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:33.323648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:33.326343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 470/934] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Sep 3 03:37:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:33.334434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:33.396470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:33.448784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4b75e-d720-47c8-bbed-2792748bd3ff None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:33.485220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f3067-5e7d-4e32-b64c-211c3b959a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:33.485849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f3067-5e7d-4e32-b64c-211c3b959a6a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:33.486453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f3067-5e7d-4e32-b64c-211c3b959a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:33.486726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f3067-5e7d-4e32-b64c-211c3b959a6a None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:33.487395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f3067-5e7d-4e32-b64c-211c3b959a6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:33.487696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f3067-5e7d-4e32-b64c-211c3b959a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:33.489091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f3067-5e7d-4e32-b64c-211c3b959a6a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:33.502571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 465/935] 10.222.0.13 () {56 vars in 1115 bytes} [Sat Sep 3 03:37:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:33.506013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:33.535738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684abb-e1e9-44ee-bb34-cf0663b68463 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:33.536249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684abb-e1e9-44ee-bb34-cf0663b68463 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:33.536679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684abb-e1e9-44ee-bb34-cf0663b68463 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:33.538789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 466/936] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:33.544325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e43ae9-3d25-4a03-9cc8-5856f188538b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:33.544822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e43ae9-3d25-4a03-9cc8-5856f188538b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:33.545368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e43ae9-3d25-4a03-9cc8-5856f188538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:33.565029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-33e43ae9-3d25-4a03-9cc8-5856f188538b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:33.566739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-33e43ae9-3d25-4a03-9cc8-5856f188538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:33.615329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4bad5-c245-4ad1-87f1-caef78fccda0 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:33.642945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 467/937] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:33.655017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:33.655907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:33.656452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:33.656961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:33.668072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:33.669905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:33.685562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:33.686565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:33.687464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:33.687464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:33.687464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:33.693624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 471/938] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:33.695824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e43ae9-3d25-4a03-9cc8-5856f188538b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:33.747884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:33.800193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e43ae9-3d25-4a03-9cc8-5856f188538b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:33.835343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:33.836330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:33.836834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:33.837391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:33.838251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:33.838759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:33.840390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:33.856741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 468/939] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:33.858852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:33.907570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:33.909663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:33.967864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49501a33-ce0a-4744-bcff-537c27b3a87c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.003639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.004005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.004252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.004523 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.012314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.013791 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.019198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837fd5a-491e-4d51-8198-6eca3f15e996 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:34.025394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:34.026379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:34.027319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:34.031499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 472/940] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:37:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:34.032369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.037313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:34.066443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.067500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.067982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.068464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.070501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.071952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.074627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING keystone.server.flask.common [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 03 03:37:34.094229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.sql.core [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 03:37:34.094229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 03:37:34.094229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [parameters: {'id': 'e1805d118ef04f02bbe38111d0d71d0b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 03:37:34.094229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87939) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1805d118ef04f02bbe38111d0d71d0b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1805d118ef04f02bbe38111d0d71d0b. Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application conn.query(q) Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 03:37:34.112188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application result.read() Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 03 03:37:34.113088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application next(self.gen) Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application yield resource Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application next(self.gen) Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise self.value Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application session.commit() Sep 03 03:37:34.114138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self.session.flush() Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application compat.raise_( Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 03:37:34.115622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 03:37:34.116514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application conn.query(q) Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application result.read() Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 03:37:34.117336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [parameters: {'id': 'e1805d118ef04f02bbe38111d0d71d0b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.119351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:34.121380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e1805d118ef04f02bbe38111d0d71d0b. Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 469/941] 10.222.0.13 () {60 vars in 1140 bytes} [Sat Sep 3 03:37:33 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:34.123583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.162354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df946ec4-81a7-4112-9c89-8c111a16b051 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.166304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:34.204751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.205548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.205955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.206322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.207161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:34.207634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.209377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.233863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 473/942] 10.222.0.13 () {56 vars in 1149 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:34.235165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.242719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7584-4daa-4962-af10-8e03619ad9ca None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.284638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc59a7-dafe-4c05-811e-439728d331ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.285876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc59a7-dafe-4c05-811e-439728d331ae None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.286262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc59a7-dafe-4c05-811e-439728d331ae None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.286647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc59a7-dafe-4c05-811e-439728d331ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.295629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc59a7-dafe-4c05-811e-439728d331ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.297526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc59a7-dafe-4c05-811e-439728d331ae None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-79bc59a7-dafe-4c05-811e-439728d331ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:34.308943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:34.310051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:34.311151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.312536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 470/943] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:34.313971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60a712-8258-4ea1-9f24-1de6d843575d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.314354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60a712-8258-4ea1-9f24-1de6d843575d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.314734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60a712-8258-4ea1-9f24-1de6d843575d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.319548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 471/944] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:34.320378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60a712-8258-4ea1-9f24-1de6d843575d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.347220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:34.357882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d58ea-4895-49cd-9a4e-1f6db28238fb None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.393237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468abf3-29eb-4c25-9236-d55fd0db8359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.394040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468abf3-29eb-4c25-9236-d55fd0db8359 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.394429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468abf3-29eb-4c25-9236-d55fd0db8359 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.394806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468abf3-29eb-4c25-9236-d55fd0db8359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.406062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468abf3-29eb-4c25-9236-d55fd0db8359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.407608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468abf3-29eb-4c25-9236-d55fd0db8359 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4468abf3-29eb-4c25-9236-d55fd0db8359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:34.425288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:34.426244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:34.427120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:34.427120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:34.427120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:34.427120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 474/945] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:34.427908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a812a-d828-4489-a671-97af78f21e51 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.428307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a812a-d828-4489-a671-97af78f21e51 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.428609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a812a-d828-4489-a671-97af78f21e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.437835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60a712-8258-4ea1-9f24-1de6d843575d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.446951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-9b2a812a-d828-4489-a671-97af78f21e51 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:34.448146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9b2a812a-d828-4489-a671-97af78f21e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:34.457664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:34.478682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.479609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.480147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.480488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.481127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:34.481437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.482870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.512945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 472/946] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:34.512945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.525334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 475/947] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:34.607721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:34.627197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec088e-8438-48e0-b9c4-477bad95b3bb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.664318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.664967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.665255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.665529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.666187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:34.666493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.667901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.685262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 473/948] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:34.689838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a812a-d828-4489-a671-97af78f21e51 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.784855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.804076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a812a-d828-4489-a671-97af78f21e51 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.850576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.852048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.852493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.852946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.862707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.864398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:34.879538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:34.880672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:34.881821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:34.889177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 476/949] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:34.891191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.897247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:34.901006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb85d00-21bc-4692-a34a-470929201f47 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:34.938208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:34.939149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:34.939588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:34.939959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:34.940841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:34.942396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:34.952655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:34.953962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:34.955004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:34.961998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 474/950] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:34.963069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:34.976697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:35.017883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c18c5-dfcc-4a42-8e5e-2c78f0cb331a None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:35.057761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5541ffa-ddb2-4634-9060-f75294f809b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:35.058766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541ffa-ddb2-4634-9060-f75294f809b5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.059267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541ffa-ddb2-4634-9060-f75294f809b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.059761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5541ffa-ddb2-4634-9060-f75294f809b5 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.060566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5541ffa-ddb2-4634-9060-f75294f809b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:35.061020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5541ffa-ddb2-4634-9060-f75294f809b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:35.062559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5541ffa-ddb2-4634-9060-f75294f809b5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:35.079522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 477/951] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:35.079522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5fc0-d8c2-4bd5-b11d-e6bd158e9ace None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.079522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5fc0-d8c2-4bd5-b11d-e6bd158e9ace None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.079522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5fc0-d8c2-4bd5-b11d-e6bd158e9ace None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.079522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 478/952] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:35.083091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5fc0-d8c2-4bd5-b11d-e6bd158e9ace None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:35.083538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67191788-fac8-4524-960a-03901b5b24f3 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:35.120673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb5c4c-ebf2-468d-ab62-134b19845051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:35.121346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb5c4c-ebf2-468d-ab62-134b19845051 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.121614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb5c4c-ebf2-468d-ab62-134b19845051 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.121874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb5c4c-ebf2-468d-ab62-134b19845051 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.123114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb5c4c-ebf2-468d-ab62-134b19845051 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:35.123114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb5c4c-ebf2-468d-ab62-134b19845051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:35.124213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb5c4c-ebf2-468d-ab62-134b19845051 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:35.129678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 475/953] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:35.130835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48dad-e3fd-4c03-922f-5d0beab67b54 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.131148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48dad-e3fd-4c03-922f-5d0beab67b54 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.131428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48dad-e3fd-4c03-922f-5d0beab67b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.149658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-deb48dad-e3fd-4c03-922f-5d0beab67b54 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:35.151165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-deb48dad-e3fd-4c03-922f-5d0beab67b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:35.163778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:35.205214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5fc0-d8c2-4bd5-b11d-e6bd158e9ace None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:35.239306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 476/954] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:35.239306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48dad-e3fd-4c03-922f-5d0beab67b54 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:35.240224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:35.259536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:35.260606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.261090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.261554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f0cdc86ba2a84930b1252299feab9913/roles/60fc0b3d025240d8ab843778145cd94e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.264017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=f0cdc86ba2a84930b1252299feab9913, role_id=60fc0b3d025240d8ab843778145cd94e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:35.265766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:35.283553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 479/955] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:37:35 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f0cdc86ba2a84930b1252299feab9913/roles/60fc0b3d025240d8ab843778145cd94e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:37:35.369101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48dad-e3fd-4c03-922f-5d0beab67b54 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:35.406283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:35.406908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.407185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.407452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.408158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:35.408456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:35.410034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:35.416551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 477/956] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:35.423065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:35.539583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a61ca-1b32-4505-8067-b1cadc7fc118 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:35.540243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:35.565323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:35.582673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:35.583344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.583630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.583903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.584668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:35.586207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:35.610901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:35.612392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 480/957] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:35.656058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad138ab-b4db-452f-ad86-5456cc80f7e1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:35.707098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:35.707654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.707930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.708196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] PATH_INFO: `/v3/services/compute` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.708786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:35.710459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:35.720598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:35.721991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:35.723173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 478/958] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:35.728316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:35.841551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923694c7-6b6f-483d-98e4-316cbf670697 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:35.876441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345ea7b-f076-478b-828d-c05d24efdcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:35.877081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345ea7b-f076-478b-828d-c05d24efdcf1 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:35.877357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345ea7b-f076-478b-828d-c05d24efdcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:35.877627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345ea7b-f076-478b-828d-c05d24efdcf1 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:35.878258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345ea7b-f076-478b-828d-c05d24efdcf1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:35.878555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345ea7b-f076-478b-828d-c05d24efdcf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:35.879925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345ea7b-f076-478b-828d-c05d24efdcf1 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:35.885473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 481/959] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:35.891034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:35.996641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7143158-5431-4de1-91d4-f232a20ec45e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:36.023881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:36.033948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a55b00-bbf1-449f-9b47-73b88f54099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:36.034795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55b00-bbf1-449f-9b47-73b88f54099b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:36.035226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55b00-bbf1-449f-9b47-73b88f54099b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:36.035650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55b00-bbf1-449f-9b47-73b88f54099b None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:36.036468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a55b00-bbf1-449f-9b47-73b88f54099b None admin] RBAC: Adding query filter params (type=compute) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:36.036984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a55b00-bbf1-449f-9b47-73b88f54099b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:36.038929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a55b00-bbf1-449f-9b47-73b88f54099b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:36.044204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 479/960] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:36.541973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d799f2-2b2c-4e8b-af8c-13eda2af1fdb None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:36.542534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d799f2-2b2c-4e8b-af8c-13eda2af1fdb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:36.542534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d799f2-2b2c-4e8b-af8c-13eda2af1fdb None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:36.544248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 482/961] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:36.549523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41d57a-6141-4444-8043-8a0e245a546a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:36.549816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41d57a-6141-4444-8043-8a0e245a546a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:36.550095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41d57a-6141-4444-8043-8a0e245a546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:36.568936 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3f41d57a-6141-4444-8043-8a0e245a546a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:36.570212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3f41d57a-6141-4444-8043-8a0e245a546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:36.643234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 480/962] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:36.914257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d799f2-2b2c-4e8b-af8c-13eda2af1fdb None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:36.964548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:37.024274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d799f2-2b2c-4e8b-af8c-13eda2af1fdb None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:37.060829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:37.061844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.062329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.062806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.063632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:37.065304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:37.068071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING keystone.server.flask.common [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 03 03:37:37.081414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.sql.core [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 03:37:37.081414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 03:37:37.081414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [parameters: {'user_id': 'a1ec02165700435a8225a225b97c2f9c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 03:37:37.081414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87938) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-52e3ddbd-deaf-40d5-8f08-05edc0bed51b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application conn.query(q) Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result.read() Sep 03 03:37:37.089502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 03:37:37.090430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application next(self.gen) Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application yield resource Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application next(self.gen) Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise self.value Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application session.commit() Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 03:37:37.091380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.session.flush() Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application compat.raise_( Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 03:37:37.092236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 03:37:37.093138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application conn.query(q) Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application result.read() Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 03:37:37.093962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a1ec02165700435a8225a225b97c2f9c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:37.094756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 03 03:37:37.096862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 03 03:37:37.099080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 03 03:37:37.099080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 03 03:37:37.099080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 03:37:37.099080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 03:37:37.099080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 03:37:37.099080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:37.101742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 483/963] 10.222.0.13 () {60 vars in 1131 bytes} [Sat Sep 3 03:37:36 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:37.113199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41d57a-6141-4444-8043-8a0e245a546a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:37.230339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41d57a-6141-4444-8043-8a0e245a546a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:37.257760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:37.267585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:37.268510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.269058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.269522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.274197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c8a1b-3220-4a3c-afe6-0b9ff5a00aa3 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.274474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c8a1b-3220-4a3c-afe6-0b9ff5a00aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.274751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c8a1b-3220-4a3c-afe6-0b9ff5a00aa3 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.278060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:37.279267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 484/964] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:37.279950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:37.284152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb87d-8daf-4d94-8f87-10cd1b2ea349 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.284436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb87d-8daf-4d94-8f87-10cd1b2ea349 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.284710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeb87d-8daf-4d94-8f87-10cd1b2ea349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:37.294434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:37.295389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 03:37:37.296311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:37.298917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 481/965] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:37.304016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-19eeb87d-8daf-4d94-8f87-10cd1b2ea349 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:37.305084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:37.305575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-19eeb87d-8daf-4d94-8f87-10cd1b2ea349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:37.385226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 485/966] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:37.423419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551905-d21d-484c-9f31-eec509efc32d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:37.457643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2083c-db7b-48e5-a5a0-b81dd32a2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:37.458609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2083c-db7b-48e5-a5a0-b81dd32a2d73 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.459097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2083c-db7b-48e5-a5a0-b81dd32a2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.459603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2083c-db7b-48e5-a5a0-b81dd32a2d73 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.460504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2083c-db7b-48e5-a5a0-b81dd32a2d73 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:37.461016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2083c-db7b-48e5-a5a0-b81dd32a2d73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:37.462637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2083c-db7b-48e5-a5a0-b81dd32a2d73 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:37.498304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 482/967] 10.222.0.13 () {56 vars in 1101 bytes} [Sat Sep 3 03:37:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:37.566186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a88f-5265-447f-9a9d-3ee88cde623b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.566744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a88f-5265-447f-9a9d-3ee88cde623b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.566744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a88f-5265-447f-9a9d-3ee88cde623b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.568389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 486/968] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:37.574132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb79eb-07e1-4c26-b865-4ce72e559d29 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.574417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb79eb-07e1-4c26-b865-4ce72e559d29 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.574687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb79eb-07e1-4c26-b865-4ce72e559d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.594005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c9eb79eb-07e1-4c26-b865-4ce72e559d29 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:37.595204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c9eb79eb-07e1-4c26-b865-4ce72e559d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:37.632672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:37.660045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a88f-5265-447f-9a9d-3ee88cde623b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:37.676781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 483/969] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:37.710994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:37.785414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a88f-5265-447f-9a9d-3ee88cde623b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:37.821161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:37.821786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.822065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.822335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.832374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:37.837255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:37.838192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:37.839028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 487/970] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Sep 3 03:37:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:37.844393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb79eb-07e1-4c26-b865-4ce72e559d29 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:37.942381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:37.949761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb79eb-07e1-4c26-b865-4ce72e559d29 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:37.987738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:37.988352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:37.988635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:37.988928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:37.989606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:37.989910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:37.991864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.004842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 484/971] 10.222.0.13 () {56 vars in 1115 bytes} [Sat Sep 3 03:37:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:38.006882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.038698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:38.046984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:38.053825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c53d9-f7da-42f1-b458-f70b7b55637d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.086936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b98b8-a6a8-4dbc-a2e4-796d21f5ca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.087563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b98b8-a6a8-4dbc-a2e4-796d21f5ca3d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.087837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b98b8-a6a8-4dbc-a2e4-796d21f5ca3d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.088113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b98b8-a6a8-4dbc-a2e4-796d21f5ca3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.088688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b98b8-a6a8-4dbc-a2e4-796d21f5ca3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.090214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b98b8-a6a8-4dbc-a2e4-796d21f5ca3d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-692b98b8-a6a8-4dbc-a2e4-796d21f5ca3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:38.098745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:38.100095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:38.101289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 488/972] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:38.102091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155c0d-fd54-468e-8f4c-db365474cc6c None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.102091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155c0d-fd54-468e-8f4c-db365474cc6c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.102091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9155c0d-fd54-468e-8f4c-db365474cc6c None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.102866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 489/973] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:38.105819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9155c0d-fd54-468e-8f4c-db365474cc6c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.115335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bc991-9bde-49f6-aa01-99802b9f7db6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.149039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858da19-0098-4b1c-bef8-f8f7c394fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.149672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858da19-0098-4b1c-bef8-f8f7c394fd90 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.149949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858da19-0098-4b1c-bef8-f8f7c394fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.150222 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858da19-0098-4b1c-bef8-f8f7c394fd90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.160541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858da19-0098-4b1c-bef8-f8f7c394fd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.162027 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858da19-0098-4b1c-bef8-f8f7c394fd90 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-2858da19-0098-4b1c-bef8-f8f7c394fd90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:38.176724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:38.178207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:38.179457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:38.179457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:38.179457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:38.179457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 485/974] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:38.179457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11df5-f7e3-4416-ac25-1404c7f99f1d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.179457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11df5-f7e3-4416-ac25-1404c7f99f1d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.179864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11df5-f7e3-4416-ac25-1404c7f99f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.197207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-21b11df5-f7e3-4416-ac25-1404c7f99f1d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:38.198398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-21b11df5-f7e3-4416-ac25-1404c7f99f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:38.213648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9155c0d-fd54-468e-8f4c-db365474cc6c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.247540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.248148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.248406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.248670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.249324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:38.249623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.250995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.256329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 490/975] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:38.257160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.268892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 486/976] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:38.270103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b11df5-f7e3-4416-ac25-1404c7f99f1d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.284447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:38.287762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:38.364601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647c3c-78bc-413f-ae1b-a53136d2c4f6 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.385876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b11df5-f7e3-4416-ac25-1404c7f99f1d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.400243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.400867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.401195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.401474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.402128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:38.402435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.403817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.420799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 491/977] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:38.421724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.424622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.426421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.426905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.427355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.428247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:38.428727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.430790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.440745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 487/978] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:38.441739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.521483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:38.526071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:38.546957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a8932-5dbd-430f-8909-6d900304b9a4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.547135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55c90a-5c96-4ce0-a8ab-c5ad9c7b7915 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.582771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.583420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.583693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.583960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.584766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.585420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.585705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.586141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.586872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] RBAC: Adding query filter params (interface=admin, service_id=8393cadf44fa43829ed52a5e968c4406, region_id=RegionOne) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:38.587181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.588584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.591195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.592629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.593661 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 488/979] 10.222.0.13 () {56 vars in 1249 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/endpoints?service_id=8393cadf44fa43829ed52a5e968c4406&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:38.594525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:38.605627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:38.606798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 492/980] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:38.607755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.698288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6419f96-a330-4e32-81e8-b8887f3606c1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.710758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c959a-bb57-4028-9d70-fedee1953183 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.731547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.732175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.732452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.732726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.733392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.734813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.744837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.745268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:38.745483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.745764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.746040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.746665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.748311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.753063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 489/981] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:38 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:38.753959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.760538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 493/982] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:37:38.888534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d241fc8-441d-4c1b-b701-1db65e80677e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:38.928409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:38.929202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:38.929476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:38.929738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:38.930469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:38.930791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:38.932279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:38.951527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 490/983] 10.222.0.13 () {56 vars in 1149 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:38.957338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:38.970047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:39.064468 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f7b54-e231-48ef-be33-1c7384c7cde1 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:39.100360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:39.100991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:39.101269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:39.101532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:39.180052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:39.181540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:39.191401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:39.295714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 494/984] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:38 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 03:37:39.301209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:39.356624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:39.402584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53a04-6880-4ce9-bb83-ce05bf7ae838 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:39.438471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:39.439118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:39.439376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:39.439642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:39.449750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:39.451266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:39.465832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:39.466815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:39.467683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:39.467683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:39.467683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:39.469320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 491/985] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:39.472596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:39.571774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef478c-ecf4-45f4-96a8-869b8acb2593 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:39.580797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:39.607080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:39.607686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:39.607939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:39.608204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:39.608835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:39.609232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:39.610597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:39.622348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 495/986] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:39.627678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:39.727503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ee544-100a-4b13-aaba-32e5fb535215 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:39.734485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:39.762892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:39.763590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:39.763945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:39.764282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:39.771332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:39.772869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:39.786774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:39.788371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:39.789292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 492/987] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:39.793720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:39.902735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bb9eb-bae8-44b7-8f0d-59fe233dd930 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:39.937914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f985de-5d40-4fc3-bb6c-73ceee2f23aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:39.938513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f985de-5d40-4fc3-bb6c-73ceee2f23aa None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:39.938786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f985de-5d40-4fc3-bb6c-73ceee2f23aa None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:39.939054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f985de-5d40-4fc3-bb6c-73ceee2f23aa None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:39.939734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f985de-5d40-4fc3-bb6c-73ceee2f23aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:39.940031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f985de-5d40-4fc3-bb6c-73ceee2f23aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:39.941514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f985de-5d40-4fc3-bb6c-73ceee2f23aa None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:39.954372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 496/988] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:39.960586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:40.060711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c7685-2553-437c-af9a-f04d364fb6bb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:40.094641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427916-f5bc-4dfd-b50d-83f7097ead91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:40.095240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427916-f5bc-4dfd-b50d-83f7097ead91 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:40.095511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427916-f5bc-4dfd-b50d-83f7097ead91 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:40.095778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427916-f5bc-4dfd-b50d-83f7097ead91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:40.096499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427916-f5bc-4dfd-b50d-83f7097ead91 None admin] RBAC: Adding query filter params (role.id=60fc0b3d025240d8ab843778145cd94e, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f0cdc86ba2a84930b1252299feab9913) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:40.096805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427916-f5bc-4dfd-b50d-83f7097ead91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:40.098409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427916-f5bc-4dfd-b50d-83f7097ead91 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:40.104884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 493/989] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:39 2022] GET /identity/v3/role_assignments?user.id=f0cdc86ba2a84930b1252299feab9913&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=60fc0b3d025240d8ab843778145cd94e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:40.685663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475c1b-3437-478e-923a-a68ac3269475 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:40.686210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475c1b-3437-478e-923a-a68ac3269475 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:40.686210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475c1b-3437-478e-923a-a68ac3269475 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:40.687497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 497/990] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:40.692947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d476-2072-475d-a540-fe394640081a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:40.693355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d476-2072-475d-a540-fe394640081a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:40.693563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6d476-2072-475d-a540-fe394640081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:40.712150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6fa6d476-2072-475d-a540-fe394640081a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:40.713345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6fa6d476-2072-475d-a540-fe394640081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:40.738543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab7ee-85ae-4c43-8cc9-9393f5518e93 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:40.738763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:40.738860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab7ee-85ae-4c43-8cc9-9393f5518e93 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:40.739073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbab7ee-85ae-4c43-8cc9-9393f5518e93 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:40.741084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 498/991] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:40.745789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a6d78-18de-481a-a603-68689d316bf9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:40.746054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a6d78-18de-481a-a603-68689d316bf9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:40.746344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a6d78-18de-481a-a603-68689d316bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:40.765419 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d04a6d78-18de-481a-a603-68689d316bf9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:40.766602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d04a6d78-18de-481a-a603-68689d316bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:40.788577 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 494/992] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:40.790553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:40.841144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 499/993] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:41.054820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6d476-2072-475d-a540-fe394640081a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.116011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a6d78-18de-481a-a603-68689d316bf9 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.181428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6d476-2072-475d-a540-fe394640081a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.228421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.229242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.229524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.230105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.231080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.232941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.235577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a6d78-18de-481a-a603-68689d316bf9 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:41.243880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:41.244859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:41.246232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 495/994] 10.222.0.13 () {56 vars in 1126 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:41.251276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.283085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:41.284094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.284747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.285066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.285367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.285951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.287483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:41.296834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:41.297912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:41.298748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 500/995] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:41.303956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.329188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:41.382188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c7fcd-882e-4b2f-bb21-e597eabd69b8 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.433491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e28f96-d0ca-4e41-8818-6d28ba9be080 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.442361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.442847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.443123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.443391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.444082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:41.444380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.445794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.450973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 496/996] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:41.456365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.471986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.473005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.473511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.473968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.475163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:41.475788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.478071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.485437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 501/997] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:41.491578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.553042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:41.567085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f25a7-f8c6-4dca-b64b-312171238bda None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.581098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:41.597179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbf74d-93fe-482d-890e-f24a38987945 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.604463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.605117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.605400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.605671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.606301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:41.606604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.607972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.618340 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 497/998] 10.222.0.13 () {56 vars in 1122 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:41.619804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.637211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.637822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.638100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.638370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.639004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:41.639303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.640668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.645556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 502/999] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:41.651470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.723789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748882e-a8e3-45ed-9dea-8c34cd0f5fc4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.759592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.760197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.760479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.760747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.761440 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.762803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.766006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecd5f-2585-40fc-af01-7365696bb142 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.788946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 498/1000] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:37:41.820242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c7888-f75e-4e8e-837c-9cc6516319d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.820986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c7888-f75e-4e8e-837c-9cc6516319d8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.821264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c7888-f75e-4e8e-837c-9cc6516319d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.821533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c7888-f75e-4e8e-837c-9cc6516319d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.822242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c7888-f75e-4e8e-837c-9cc6516319d8 None admin] RBAC: Adding query filter params (interface=public, service_id=fb6361d7ac0e44d9b8748b40e0408c31, region_id=RegionOne) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:41.822549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c7888-f75e-4e8e-837c-9cc6516319d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:41.823926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c7888-f75e-4e8e-837c-9cc6516319d8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:41.830008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 503/1001] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/endpoints?service_id=fb6361d7ac0e44d9b8748b40e0408c31&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:41.836816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:41.854607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:41.963491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b79da-5e6a-424b-ad6b-3a48b464b60a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:41.997993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56608-09cd-4187-971f-5dfe47f8783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:41.998609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56608-09cd-4187-971f-5dfe47f8783d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:41.998888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56608-09cd-4187-971f-5dfe47f8783d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:41.999161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56608-09cd-4187-971f-5dfe47f8783d None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:41.999749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be56608-09cd-4187-971f-5dfe47f8783d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:42.001155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be56608-09cd-4187-971f-5dfe47f8783d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:42.013040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 499/1002] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:41 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:37:42.043403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a563ce-1cb2-4657-9106-73771cbf53ef None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:42.043747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a563ce-1cb2-4657-9106-73771cbf53ef None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:42.043914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a563ce-1cb2-4657-9106-73771cbf53ef None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:42.045543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 504/1003] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:42.051043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d06f-8205-4152-9c27-236cd03ea410 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:42.051428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d06f-8205-4152-9c27-236cd03ea410 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:42.051590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23d06f-8205-4152-9c27-236cd03ea410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:42.071619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-fc23d06f-8205-4152-9c27-236cd03ea410 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:42.072844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fc23d06f-8205-4152-9c27-236cd03ea410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:42.147279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 500/1004] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:42.411745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a563ce-1cb2-4657-9106-73771cbf53ef None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:42.425658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:42.521554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a563ce-1cb2-4657-9106-73771cbf53ef None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:42.557246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:42.557871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:42.558145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:42.558411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:42.558978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:42.560337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:42.569121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:42.573385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:42.574319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 505/1005] 10.222.0.13 () {56 vars in 1105 bytes} [Sat Sep 3 03:37:42 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:42.576415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23d06f-8205-4152-9c27-236cd03ea410 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:42.585044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:42.679296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23d06f-8205-4152-9c27-236cd03ea410 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:42.714575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81381df-ebb3-404d-aead-bda0fa3c98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:42.715258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81381df-ebb3-404d-aead-bda0fa3c98ec None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:42.715601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81381df-ebb3-404d-aead-bda0fa3c98ec None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:42.715935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81381df-ebb3-404d-aead-bda0fa3c98ec None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:42.716622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81381df-ebb3-404d-aead-bda0fa3c98ec None admin] RBAC: Adding query filter params (name=image) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:42.717019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81381df-ebb3-404d-aead-bda0fa3c98ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:42.718441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81381df-ebb3-404d-aead-bda0fa3c98ec None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:42.723405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 501/1006] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:42.729079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:42.808874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:42.835999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949064a9-5bf0-4cd2-a0fe-36ff702615c3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:42.870006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839b880-da47-49e7-bf60-08394ec131df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:42.870624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b880-da47-49e7-bf60-08394ec131df None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:42.870909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b880-da47-49e7-bf60-08394ec131df None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:42.871182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839b880-da47-49e7-bf60-08394ec131df None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:42.871822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839b880-da47-49e7-bf60-08394ec131df None admin] RBAC: Adding query filter params (type=image) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:42.872128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839b880-da47-49e7-bf60-08394ec131df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:42.873582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839b880-da47-49e7-bf60-08394ec131df None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:42.879100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 506/1007] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:43.720617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a5ab-1a84-4dc0-89c0-be3d8d2b4bff None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:43.721191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a5ab-1a84-4dc0-89c0-be3d8d2b4bff None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:43.721191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a5ab-1a84-4dc0-89c0-be3d8d2b4bff None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:43.724948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 502/1008] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:43.728121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadbeec-48b3-4d35-95c5-40cbf5ff06f6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:43.728415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadbeec-48b3-4d35-95c5-40cbf5ff06f6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:43.728691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadbeec-48b3-4d35-95c5-40cbf5ff06f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:43.748264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-3dadbeec-48b3-4d35-95c5-40cbf5ff06f6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:43.749497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3dadbeec-48b3-4d35-95c5-40cbf5ff06f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:43.821245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 507/1009] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:43.947845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb95222-84db-42ef-af74-91dc2c05470b None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:43.948210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb95222-84db-42ef-af74-91dc2c05470b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:43.948393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb95222-84db-42ef-af74-91dc2c05470b None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:43.949929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 503/1010] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:43.955092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b327-384c-40ae-bdf9-34138e621e1d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:43.955383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b327-384c-40ae-bdf9-34138e621e1d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:43.955640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b327-384c-40ae-bdf9-34138e621e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:43.975095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e836b327-384c-40ae-bdf9-34138e621e1d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:43.976485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e836b327-384c-40ae-bdf9-34138e621e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:44.040404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:44.046909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 508/1011] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:44.085273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb95222-84db-42ef-af74-91dc2c05470b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:44.164516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:44.200801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb95222-84db-42ef-af74-91dc2c05470b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:44.235316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:44.235929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.236579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.236858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.238029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:44.239511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:44.244969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 504/1012] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:44.247243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b327-384c-40ae-bdf9-34138e621e1d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:44.315785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:44.355793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b327-384c-40ae-bdf9-34138e621e1d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:44.391311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:44.391918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.392195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.392506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.393136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:44.394580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:44.423671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 509/1013] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:44 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:44.431155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4975-0a53-442b-8335-67fd1ff49052 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:44.471834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:44.472489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.472766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.473068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.473658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:44.475152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:44.485614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:44.489314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:44.490166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 505/1014] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:44.493869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:44.549484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:44.607222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541391-640d-4143-a423-5e59b3341c6e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:44.642496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888777c0-59b8-45b2-acd1-78a519170058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:44.643283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888777c0-59b8-45b2-acd1-78a519170058 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.643658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888777c0-59b8-45b2-acd1-78a519170058 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.644025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888777c0-59b8-45b2-acd1-78a519170058 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.644765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888777c0-59b8-45b2-acd1-78a519170058 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:44.645190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888777c0-59b8-45b2-acd1-78a519170058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:44.646692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888777c0-59b8-45b2-acd1-78a519170058 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:44.651993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 510/1015] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:44.657965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:44.660842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:44.762618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a3888-5050-4c4c-9254-c17791686557 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:44.763213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be026bb-d1b1-482d-9189-efaed7922d73 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.763213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be026bb-d1b1-482d-9189-efaed7922d73 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.763540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be026bb-d1b1-482d-9189-efaed7922d73 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.765925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 511/1016] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:44.771379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81465fd-c650-4c95-9093-4c2e94e73fe4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.771970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81465fd-c650-4c95-9093-4c2e94e73fe4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.772474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81465fd-c650-4c95-9093-4c2e94e73fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.791992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f81465fd-c650-4c95-9093-4c2e94e73fe4 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:44.793305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f81465fd-c650-4c95-9093-4c2e94e73fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:44.798460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:44.799077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.799356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.799626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.800256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:44.800558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:44.801957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:44.807971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 506/1017] 10.222.0.13 () {56 vars in 1112 bytes} [Sat Sep 3 03:37:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:44.813600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:44.864446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 512/1018] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:44.884972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:44.923466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b09c7-18c9-476b-ae8b-884516df0189 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:44.958219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4852bee-3e86-489f-a1dd-55f769c643e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:44.958826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4852bee-3e86-489f-a1dd-55f769c643e4 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:44.959178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4852bee-3e86-489f-a1dd-55f769c643e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:44.959665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4852bee-3e86-489f-a1dd-55f769c643e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:44.960378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4852bee-3e86-489f-a1dd-55f769c643e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:44.961788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4852bee-3e86-489f-a1dd-55f769c643e4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:44.983299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 507/1019] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:45.142730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81465fd-c650-4c95-9093-4c2e94e73fe4 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:45.189783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:45.249235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81465fd-c650-4c95-9093-4c2e94e73fe4 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:45.291622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e3208-44fa-49bf-9c1b-1045209497d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:45.292234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3208-44fa-49bf-9c1b-1045209497d7 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:45.292516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3208-44fa-49bf-9c1b-1045209497d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:45.292783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e3208-44fa-49bf-9c1b-1045209497d7 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:45.293505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e3208-44fa-49bf-9c1b-1045209497d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:45.294880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e3208-44fa-49bf-9c1b-1045209497d7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:45.312142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 513/1020] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:37:45 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:46.371046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5e161-98bc-45cf-8033-305fbb9ceb87 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:46.371645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5e161-98bc-45cf-8033-305fbb9ceb87 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:46.371645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5e161-98bc-45cf-8033-305fbb9ceb87 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:46.372955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 508/1021] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:46.378811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabe5bc-000a-4f15-9880-9cd823ed3a59 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:46.379357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabe5bc-000a-4f15-9880-9cd823ed3a59 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:46.379357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabe5bc-000a-4f15-9880-9cd823ed3a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:46.398106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-bdabe5bc-000a-4f15-9880-9cd823ed3a59 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:46.399280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bdabe5bc-000a-4f15-9880-9cd823ed3a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:46.474390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 514/1022] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:46.746359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5e161-98bc-45cf-8033-305fbb9ceb87 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:46.864775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5e161-98bc-45cf-8033-305fbb9ceb87 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:46.887634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:46.903841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728402f-dcb5-4dcc-95c2-812c48e20012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:46.904488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728402f-dcb5-4dcc-95c2-812c48e20012 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:46.904761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728402f-dcb5-4dcc-95c2-812c48e20012 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:46.905054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728402f-dcb5-4dcc-95c2-812c48e20012 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:46.906186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728402f-dcb5-4dcc-95c2-812c48e20012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:46.907611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728402f-dcb5-4dcc-95c2-812c48e20012 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:46.909388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 509/1023] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:46.915286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabe5bc-000a-4f15-9880-9cd823ed3a59 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:46.944159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:47.029890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabe5bc-000a-4f15-9880-9cd823ed3a59 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:47.076597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5e757-2998-4e40-8507-c1b7b067f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:47.077429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e757-2998-4e40-8507-c1b7b067f4e5 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.077626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e757-2998-4e40-8507-c1b7b067f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.077881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5e757-2998-4e40-8507-c1b7b067f4e5 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.078552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e757-2998-4e40-8507-c1b7b067f4e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:47.078940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ecb9-999a-45bc-99f3-b98879220f30 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.079220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ecb9-999a-45bc-99f3-b98879220f30 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.079480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ecb9-999a-45bc-99f3-b98879220f30 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.080003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5e757-2998-4e40-8507-c1b7b067f4e5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:47.081035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 510/1024] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:47.086397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccdb9-4b1b-4c3b-a159-c32aeb830c6b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.086721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccdb9-4b1b-4c3b-a159-c32aeb830c6b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.087009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccdb9-4b1b-4c3b-a159-c32aeb830c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.106720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d9eccdb9-4b1b-4c3b-a159-c32aeb830c6b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:47.107969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d9eccdb9-4b1b-4c3b-a159-c32aeb830c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:47.112332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 515/1025] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:37:46 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:47.205820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 511/1026] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:47.246862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db184a90-1bf5-410f-9e39-646085f2a54e None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.247202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db184a90-1bf5-410f-9e39-646085f2a54e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.247416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db184a90-1bf5-410f-9e39-646085f2a54e None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.249015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 516/1027] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:47.254570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4115c-a339-446b-95fc-76453fa13650 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.254918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4115c-a339-446b-95fc-76453fa13650 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.255123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4115c-a339-446b-95fc-76453fa13650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.275887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f5c4115c-a339-446b-95fc-76453fa13650 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:47.277199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f5c4115c-a339-446b-95fc-76453fa13650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:47.364542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 512/1028] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:47.507574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db184a90-1bf5-410f-9e39-646085f2a54e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:47.615711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:47.633785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4115c-a339-446b-95fc-76453fa13650 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:47.637603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db184a90-1bf5-410f-9e39-646085f2a54e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:47.674479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:47.675081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.675372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.675637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.686294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:47.691084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:47.692047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:47.692869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:47.693639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:47.693713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 517/1029] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Sep 3 03:37:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:47.699127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:47.752389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4115c-a339-446b-95fc-76453fa13650 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:47.787670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:47.788303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.788578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.788851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] PATH_INFO: `/v3/services/image` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.789458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:47.790816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:47.799466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:47.800666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:47.801745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:47.805578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 513/1030] 10.222.0.13 () {56 vars in 1105 bytes} [Sat Sep 3 03:37:47 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:47.806625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:47.815238 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebe8d-02c1-45d3-983d-c9b3e69d8075 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:47.857397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:47.858050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.858328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.858750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.859245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:47.859542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:47.861270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:47.870016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 518/1031] 10.222.0.13 () {56 vars in 1115 bytes} [Sat Sep 3 03:37:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:47.875480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:47.879607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:47.911951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f78d2-8233-4725-b53e-0c956f2a3514 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:47.925729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:47.948197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:47.948803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:47.949111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:47.949386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:47.950018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:47.950317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:47.951688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:47.961324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 514/1032] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:47.962494 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:47.985292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0567-4b1a-4417-8dee-f982d99f5291 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.022342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.023232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.023511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.023793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.034702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.036161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:48.050776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:48.051775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:48.052765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:48.052765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:48.052765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:48.052765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 519/1033] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:48.058389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:48.066529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5dfe-8059-4a06-b966-8d26f6b159e1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.104439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.105225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.105499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.105780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.106391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] RBAC: Adding query filter params (type=image) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:48.106694 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.108062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.116233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 515/1034] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:48.122280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:48.122488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:48.169855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:48.177191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bc80e-7a4d-4ee8-9894-8cd3b1dbe1b9 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.217155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.218091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.218970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.219429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.220533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:48.221194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.223367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.232103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3e630-d6b1-4772-a0f6-00cfad1ac4dd None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.236902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 520/1035] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:48.242261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:48.269896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.270537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.270817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.271136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.271977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] RBAC: Adding query filter params (interface=public, service_id=c57aa6f9d37545f9b6c21d40a76c8c12, region_id=RegionOne) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:48.272425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.273676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.279503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 516/1036] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:37:48 2022] GET /identity/v3/endpoints?service_id=c57aa6f9d37545f9b6c21d40a76c8c12&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:48.284845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:48.357625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b41419-30e5-4508-b6c2-9ec38324907f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.376026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:48.390685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee7f2-8ff2-44e6-a8ec-2b88be323d2a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.396773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.397464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.397734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.398004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.398246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:48.406332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.407787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:48.420433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:48.421445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:48.422403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 521/1037] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:37:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:48.427713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:48.431002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.431617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.431899 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.432172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.432780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.434187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.452953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 517/1038] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:37:48 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:37:48.542082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f473ff-b8d1-425e-bd0a-a3d546d8dc0f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.581619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.582204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.582492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.582765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.583801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:48.583801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.585377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.607034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 522/1039] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:37:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:48.613271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:48.718262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd108b-566e-4196-b009-47f4d7756901 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:48.753529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:48.754145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:48.754426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:48.754698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:48.795171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:48.827821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:48.829304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:48.944716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 518/1040] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:48.945616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:48.980423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:49.050638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc65cf-605e-4827-af0d-4ae6b2fb21c4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:49.085379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b0b28-9878-4852-9dc9-a5caf67050fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:49.086016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b0b28-9878-4852-9dc9-a5caf67050fc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.086296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b0b28-9878-4852-9dc9-a5caf67050fc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.086573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b0b28-9878-4852-9dc9-a5caf67050fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.097315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b0b28-9878-4852-9dc9-a5caf67050fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:49.098766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b0b28-9878-4852-9dc9-a5caf67050fc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-9a8b0b28-9878-4852-9dc9-a5caf67050fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:49.113826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:49.114785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:49.115794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:49.115794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:49.115794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:49.117258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 523/1041] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:49.121096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:49.164928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d8c8-937e-44c3-9331-573818191dea None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.165247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d8c8-937e-44c3-9331-573818191dea None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.165517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d8c8-937e-44c3-9331-573818191dea None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.168816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 524/1042] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:49.174157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827333-926e-4a01-83b9-ab4cc0a41060 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.174441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827333-926e-4a01-83b9-ab4cc0a41060 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.174711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827333-926e-4a01-83b9-ab4cc0a41060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.193884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-6c827333-926e-4a01-83b9-ab4cc0a41060 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:49.195116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6c827333-926e-4a01-83b9-ab4cc0a41060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:49.200451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:49.234530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decb530-aa11-415c-8209-46569c8988b1 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:49.264986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 525/1043] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:49.276353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:49.277137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.277491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.277835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.278548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:49.278916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:49.280357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:49.293049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 519/1044] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:49.298263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c827333-926e-4a01-83b9-ab4cc0a41060 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:49.316976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:49.403704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c827333-926e-4a01-83b9-ab4cc0a41060 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:49.438931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:49.439564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.439827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.440092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.446950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:49.448406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:49.459598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:49.460556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:49.466392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 526/1045] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:49.468943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:49.535381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:49.582333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b762962-61aa-440c-a90b-5336def6a26e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:49.615420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:49.622421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:49.623303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.623784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.624245 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.625176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:49.625599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:49.627254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:49.627724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:49.644994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 520/1046] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:49.647149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:49.657771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6029-0d0c-4e95-bb1d-ca1f394f237c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:49.695176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:49.695806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.696083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.696353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.707115 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:49.712670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:49.713734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:49.714565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 527/1047] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:49.719723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:49.752308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d340ee-0f86-424e-b661-31bd51a46f51 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:49.789308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:49.789960 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.790245 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.790523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.791240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] RBAC: Adding query filter params (role.id=60fc0b3d025240d8ab843778145cd94e, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=b74a8d0579ba402c8f64fa7a6bb24658) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:49.791549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:49.792966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:49.798747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 521/1048] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:49 2022] GET /identity/v3/role_assignments?user.id=b74a8d0579ba402c8f64fa7a6bb24658&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=60fc0b3d025240d8ab843778145cd94e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:49.831208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8680f4-f07f-4654-bc70-3aff45ff580b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:49.869203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:49.869825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:49.870100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:49.870432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:49.871103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:49.871418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:49.872788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:49.875476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:49.884897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 528/1049] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:49.890711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:49.952774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:50.001449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df709b03-0ab5-4a1a-8d30-984de58d275a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:50.036199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507157ef-178d-423b-ba5a-c20ca1f03c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:50.036841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507157ef-178d-423b-ba5a-c20ca1f03c7d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:50.037177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507157ef-178d-423b-ba5a-c20ca1f03c7d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:50.037452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507157ef-178d-423b-ba5a-c20ca1f03c7d None admin] PATH_INFO: `/v3/users/bb9bdac9bd62456788d0ec6bdf491000` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:50.051636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507157ef-178d-423b-ba5a-c20ca1f03c7d None admin] RBAC: Authorizing `identity:get_user(user_id=bb9bdac9bd62456788d0ec6bdf491000)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:50.053099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507157ef-178d-423b-ba5a-c20ca1f03c7d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:50.055131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 522/1050] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:37:49 2022] GET /identity/v3/users/bb9bdac9bd62456788d0ec6bdf491000 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:50.060902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:50.174052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea529ad-4007-48ba-9ef7-9495f735532c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:50.210758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:50.211372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:50.211651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:50.211923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:50.278170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:50.282533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:50.284351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:50.355805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048855be-c54d-4eaf-b629-f354be87cd94 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:50.356007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048855be-c54d-4eaf-b629-f354be87cd94 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:50.356260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048855be-c54d-4eaf-b629-f354be87cd94 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:50.357778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 523/1051] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:37:50.362861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2caa-0b24-4414-b211-26de7ba34b68 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:50.363144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2caa-0b24-4414-b211-26de7ba34b68 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:50.363410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2caa-0b24-4414-b211-26de7ba34b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:50.382044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c23f2caa-0b24-4414-b211-26de7ba34b68 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:50.383223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c23f2caa-0b24-4414-b211-26de7ba34b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:50.389076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 529/1052] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:50.391775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:50.452527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 524/1053] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:37:50.494429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:50.498658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd81e-ea49-4aca-a792-681b6da7a064 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:50.534418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:50.535044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:50.535323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:50.535593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:50.536697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] RBAC: Authorizing `identity:get_project(project_id=31288be8014a459a864d6f0057752d6e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:50.538441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:50.540223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 530/1054] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:37:50 2022] GET /identity/v3/projects/31288be8014a459a864d6f0057752d6e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:50.546512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f2caa-0b24-4414-b211-26de7ba34b68 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:50.589702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:50.648785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f2caa-0b24-4414-b211-26de7ba34b68 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:50.682636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:50.683235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:50.683510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:50.683779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:50.684498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=31288be8014a459a864d6f0057752d6e, user.id=bb9bdac9bd62456788d0ec6bdf491000) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:50.684803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:50.686264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:50.700984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 525/1055] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:50 2022] GET /identity/v3/role_assignments?user.id=bb9bdac9bd62456788d0ec6bdf491000&scope.project.id=31288be8014a459a864d6f0057752d6e&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:50.720085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:50.837381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588db81-a6ab-4406-b590-d5d068a69a50 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:50.874942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:50.875579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:50.875854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:50.876119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] PATH_INFO: `/v3/services/image` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:50.876697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:50.878095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:50.887181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:50.888160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:50.889601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 531/1056] 10.222.0.13 () {56 vars in 1105 bytes} [Sat Sep 3 03:37:50 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:50.894246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:50.998286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6c75-25a6-4435-9d64-ff530be8d501 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:51.005200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:51.033565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:51.034177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:51.034455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:51.034728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:51.035357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] RBAC: Adding query filter params (name=image) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:51.035660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:51.037190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:51.042624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 526/1057] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:51.048146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:51.080647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:51.154193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58baf54-b2f2-4700-ac36-ae7b7e456916 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:51.197140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617eda4-8616-45f6-9ebe-14018c45dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:51.198054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617eda4-8616-45f6-9ebe-14018c45dda2 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:51.198509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617eda4-8616-45f6-9ebe-14018c45dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:51.198954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617eda4-8616-45f6-9ebe-14018c45dda2 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:51.199794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617eda4-8616-45f6-9ebe-14018c45dda2 None admin] RBAC: Adding query filter params (type=image) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:51.200278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617eda4-8616-45f6-9ebe-14018c45dda2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:51.201971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617eda4-8616-45f6-9ebe-14018c45dda2 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:51.211988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 532/1058] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:51.213436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:51.325599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6665d-7eb3-44eb-a2a4-ac2b9cbd365e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:51.360378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3e12e-1b7f-47ed-8c47-f51aaeb843e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:51.361327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3e12e-1b7f-47ed-8c47-f51aaeb843e3 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:51.361621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3e12e-1b7f-47ed-8c47-f51aaeb843e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:51.361892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3e12e-1b7f-47ed-8c47-f51aaeb843e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:51.362562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3e12e-1b7f-47ed-8c47-f51aaeb843e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:51.363933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3e12e-1b7f-47ed-8c47-f51aaeb843e3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:51.392692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 527/1059] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:37:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:37:51.684574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97e0d7-5158-4b78-bab3-40e8c044b2b6 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:51.684957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97e0d7-5158-4b78-bab3-40e8c044b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:51.685153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97e0d7-5158-4b78-bab3-40e8c044b2b6 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:51.686681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 533/1060] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:51.691817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04f64-1d71-4472-88c3-de35f5ae782e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:51.692076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04f64-1d71-4472-88c3-de35f5ae782e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:51.692376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a04f64-1d71-4472-88c3-de35f5ae782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:51.712229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-89a04f64-1d71-4472-88c3-de35f5ae782e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:51.713442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-89a04f64-1d71-4472-88c3-de35f5ae782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:51.734425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:51.792654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 528/1061] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:52.055648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97e0d7-5158-4b78-bab3-40e8c044b2b6 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:52.163965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:52.173971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97e0d7-5158-4b78-bab3-40e8c044b2b6 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:52.209654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:52.210291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:52.210567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:52.210893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:52.221382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:52.226262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:52.227201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:52.229828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 534/1062] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Sep 3 03:37:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:52.233467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04f64-1d71-4472-88c3-de35f5ae782e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:52.335868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a04f64-1d71-4472-88c3-de35f5ae782e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:52.370711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:52.371323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:52.371602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:52.371873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:52.372533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:52.372835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:52.374226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:52.386990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 529/1063] 10.222.0.13 () {56 vars in 1115 bytes} [Sat Sep 3 03:37:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:52.388213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:52.497921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a45763-2fe3-4695-90cd-c5fcd8e63591 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:52.533313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78862230-fec8-48f1-95f8-38698798340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:52.533961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78862230-fec8-48f1-95f8-38698798340c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:52.534240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78862230-fec8-48f1-95f8-38698798340c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:52.534512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78862230-fec8-48f1-95f8-38698798340c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:52.545213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78862230-fec8-48f1-95f8-38698798340c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:52.546674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78862230-fec8-48f1-95f8-38698798340c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-78862230-fec8-48f1-95f8-38698798340c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:52.561519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:52.562458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:52.563340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:52.563340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:52.563340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:52.563340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 535/1064] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:52.569644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:52.579659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc02d0-6569-4e9a-b424-36e335dcb922 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:52.579997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc02d0-6569-4e9a-b424-36e335dcb922 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:52.580271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc02d0-6569-4e9a-b424-36e335dcb922 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:52.581671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 536/1065] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:52.586697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa30d-1b53-42bd-ad92-71dbeb9c0f10 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:52.586936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa30d-1b53-42bd-ad92-71dbeb9c0f10 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:52.587198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa30d-1b53-42bd-ad92-71dbeb9c0f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:52.588089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:52.601341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:52.606869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-480aa30d-1b53-42bd-ad92-71dbeb9c0f10 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:52.608065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-480aa30d-1b53-42bd-ad92-71dbeb9c0f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:52.675659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427430-d69d-4cb6-88e1-4bfa01145ff3 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:52.676632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 537/1066] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:52.710085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:52.710696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:52.710976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:52.711233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:52.711882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:52.712182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:52.713581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:52.725772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 530/1067] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:52.731506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aa30d-1b53-42bd-ad92-71dbeb9c0f10 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:52.834277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aa30d-1b53-42bd-ad92-71dbeb9c0f10 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:52.871542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:52.872092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:52.872369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:52.872634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:52.875570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:52.881447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:52.882911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:52.894724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:52.895654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:52.896962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:52.900586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 538/1068] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:37:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:52.901835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:52.939449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:52.990527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.018209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33709f-11f1-4cc5-9b00-c9fe8c8ec2cc None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.042040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f070e3-fb55-475b-9210-a1ea2f9ead99 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.055644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.056263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.056540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.056815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.057574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:53.057878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.059639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.075759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.076397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.076679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.076986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.078919 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 531/1069] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:37:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:53.084907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.089126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:53.093966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:53.094921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:53.097845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 539/1070] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:53.101103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.156978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.206065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34e9e1-1a5f-4f37-b488-23fbc0308dd5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.208286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b6f94-c013-4c1f-aff3-1cbc7d89d104 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.243076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.245359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.246047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.246452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.246728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.247420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:53.247720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.249104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.249221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.249754 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.250268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.250548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.258822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 540/1071] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:53.261694 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.263155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.264375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:53.280508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:53.281560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:53.282445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:53.282445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:53.282445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:53.282445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 532/1072] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:53.287600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.370292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda878-6822-40ad-8cd8-5d0caf494d67 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.388073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.391610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4e7f-dbab-4dfa-9058-aebebc93a92d None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.405792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7b594-9ac4-442a-807c-e9f96e345015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.406424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7b594-9ac4-442a-807c-e9f96e345015 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.406699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7b594-9ac4-442a-807c-e9f96e345015 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.406970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7b594-9ac4-442a-807c-e9f96e345015 None admin] PATH_INFO: `/v3/users/bb9bdac9bd62456788d0ec6bdf491000` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.408142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7b594-9ac4-442a-807c-e9f96e345015 None admin] RBAC: Authorizing `identity:get_user(user_id=bb9bdac9bd62456788d0ec6bdf491000)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.409570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7b594-9ac4-442a-807c-e9f96e345015 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.411297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 541/1073] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/users/bb9bdac9bd62456788d0ec6bdf491000 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:53.412342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea060144-8037-4e4c-89c0-bccabf10b57b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.412621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea060144-8037-4e4c-89c0-bccabf10b57b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.412893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea060144-8037-4e4c-89c0-bccabf10b57b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.416960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 542/1074] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:53.418045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea060144-8037-4e4c-89c0-bccabf10b57b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.432560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7b4a2-168c-4483-9861-5718d945d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.433205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7b4a2-168c-4483-9861-5718d945d497 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.433479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7b4a2-168c-4483-9861-5718d945d497 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.433994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7b4a2-168c-4483-9861-5718d945d497 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.434377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7b4a2-168c-4483-9861-5718d945d497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:53.434676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7b4a2-168c-4483-9861-5718d945d497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.436023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7b4a2-168c-4483-9861-5718d945d497 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.448286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 533/1075] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:53.449473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e9fc-0261-4ace-b9a1-ef8cbdabd93e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.449752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e9fc-0261-4ace-b9a1-ef8cbdabd93e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.450006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e9fc-0261-4ace-b9a1-ef8cbdabd93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.467204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6a92e9fc-0261-4ace-b9a1-ef8cbdabd93e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:53.468380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6a92e9fc-0261-4ace-b9a1-ef8cbdabd93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:53.510580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.525474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea060144-8037-4e4c-89c0-bccabf10b57b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.539334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 534/1076] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:53.540170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92e9fc-0261-4ace-b9a1-ef8cbdabd93e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.567774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.568463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.568737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.569245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.570403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=31288be8014a459a864d6f0057752d6e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.571805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.573602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 543/1077] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/projects/31288be8014a459a864d6f0057752d6e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:53.580082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.639643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.656146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92e9fc-0261-4ace-b9a1-ef8cbdabd93e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.684834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec5459-3cbd-4562-8a75-0ac39afcb8b6 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.692321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.692979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.693278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.693545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.700761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.702367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:53.714284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:53.715176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:53.716050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 535/1078] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:53.721078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.723024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.723687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.723960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.724230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e/users/bb9bdac9bd62456788d0ec6bdf491000/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.726206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=31288be8014a459a864d6f0057752d6e, user_id=bb9bdac9bd62456788d0ec6bdf491000, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.727631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.743400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 544/1079] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:37:53 2022] PUT /identity/v3/projects/31288be8014a459a864d6f0057752d6e/users/bb9bdac9bd62456788d0ec6bdf491000/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:37:53.758270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.809447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.841104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a97dce-7d18-4f3a-905a-8d7fd0231e4b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.885290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.886468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.886468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.886468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:53.887138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:53.887447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:53.888881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:53.902912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 536/1080] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:53.908944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:53.923809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27ebc-4fba-474d-a990-e35e293704b5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:53.940449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:53.964450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:53.965164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:53.965433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:53.965704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:54.005908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:54.013333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0cc52-89c7-4526-827f-6c4277c62d1c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:54.038387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:54.039859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:54.047951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:54.048615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:54.048895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:54.049198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/b74a8d0579ba402c8f64fa7a6bb24658/roles/60fc0b3d025240d8ab843778145cd94e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:54.051349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=b74a8d0579ba402c8f64fa7a6bb24658, role_id=60fc0b3d025240d8ab843778145cd94e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:54.052781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:54.067043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 537/1081] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:37:53 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/b74a8d0579ba402c8f64fa7a6bb24658/roles/60fc0b3d025240d8ab843778145cd94e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:37:54.164953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 545/1082] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 03:37:54.169850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:54.282789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bb862-ece0-4fa9-b33d-22379b838251 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:54.318946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb912b8-599a-4163-8fe6-8d5abb1af669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:54.319892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb912b8-599a-4163-8fe6-8d5abb1af669 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:54.320344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb912b8-599a-4163-8fe6-8d5abb1af669 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:54.320794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb912b8-599a-4163-8fe6-8d5abb1af669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:54.331627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb912b8-599a-4163-8fe6-8d5abb1af669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:54.333324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb912b8-599a-4163-8fe6-8d5abb1af669 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-eeb912b8-599a-4163-8fe6-8d5abb1af669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:54.348112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:54.349104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:54.350098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:54.350098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:54.350098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:54.350266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 538/1083] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:54.356533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:54.373146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:54.477445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1eee-fd6c-4af5-82ff-4e2d7b86668c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:54.514308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656715a1-b49e-4c72-b974-e3db9199c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:54.514940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656715a1-b49e-4c72-b974-e3db9199c303 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:54.515220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656715a1-b49e-4c72-b974-e3db9199c303 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:54.515488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656715a1-b49e-4c72-b974-e3db9199c303 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:54.516151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656715a1-b49e-4c72-b974-e3db9199c303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:54.516452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656715a1-b49e-4c72-b974-e3db9199c303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:54.517885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656715a1-b49e-4c72-b974-e3db9199c303 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:54.530155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 546/1084] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:55.626624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42418e08-a8be-455a-aa03-bc9897232d17 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:55.627170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42418e08-a8be-455a-aa03-bc9897232d17 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:55.627170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42418e08-a8be-455a-aa03-bc9897232d17 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:55.628439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 539/1085] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:55.634067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63834e-cf32-44c8-8199-c4c0c6adaac0 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:55.634512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63834e-cf32-44c8-8199-c4c0c6adaac0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:55.634600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63834e-cf32-44c8-8199-c4c0c6adaac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:55.653511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-aa63834e-cf32-44c8-8199-c4c0c6adaac0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:55.654674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aa63834e-cf32-44c8-8199-c4c0c6adaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:55.723252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 547/1086] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:55.951918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045f77c-1edb-4c3b-ab82-eb76210a2b80 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:55.952171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045f77c-1edb-4c3b-ab82-eb76210a2b80 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:55.952463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045f77c-1edb-4c3b-ab82-eb76210a2b80 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:55.954007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 540/1087] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:55.959368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777949a-083b-453d-8872-a3d6547379c3 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:55.959656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777949a-083b-453d-8872-a3d6547379c3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:55.959928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777949a-083b-453d-8872-a3d6547379c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:55.967811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:55.979616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0777949a-083b-453d-8872-a3d6547379c3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:55.980846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0777949a-083b-453d-8872-a3d6547379c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:55.989549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045f77c-1edb-4c3b-ab82-eb76210a2b80 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:55.999287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:56.048840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 548/1088] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:56.101555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045f77c-1edb-4c3b-ab82-eb76210a2b80 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.139181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.139810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.140092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.140357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.151251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:56.156035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:56.157032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:56.160827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 541/1089] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:37:56.163461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777949a-083b-453d-8872-a3d6547379c3 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.262746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777949a-083b-453d-8872-a3d6547379c3 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.295162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.295769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.296048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.296317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.296978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:56.297308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:56.298670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:56.300017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:56.307597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 549/1090] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:56.313333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.313503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.378719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:56.412676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d17e5-2e2e-4860-8af9-9fbf237c0514 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.417958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f745f-2901-4575-8cdd-64c628f9b227 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.445342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.445975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.446253 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.446551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] PATH_INFO: `/v3/users/bb9bdac9bd62456788d0ec6bdf491000` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.447666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] RBAC: Authorizing `identity:get_user(user_id=bb9bdac9bd62456788d0ec6bdf491000)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:56.449145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:56.450765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 550/1091] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/users/bb9bdac9bd62456788d0ec6bdf491000 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:56.451705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.452415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.452697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.453008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.456465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.464669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:37:56.469464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:56.470575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:56.471630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 542/1092] 10.222.0.13 () {56 vars in 1120 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:56.476410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.523005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:56.560724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05452767-4b7f-4e58-85aa-109a33577cdc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.577561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9faa0-53fb-49a9-bc40-687321d2c956 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.594540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.595513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.595822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.596094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.602183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:56.611738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.612379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.612653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.612951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.613639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:56.613978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:56.615360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:56.624154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 543/1093] 10.222.0.13 () {56 vars in 1115 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:56.629989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.670121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:56.671585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:56.727600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da669-ea8f-4bc5-8a09-47249a77a073 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.732234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:56.761802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.762424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.762702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.762970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.771575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 551/1094] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:56.774105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:56.775485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:56.777454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:56.790696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:56.791716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:56.792968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:56.792968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:56.792968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:56.792968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 544/1095] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:56.797585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.840603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:56.878260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be2a0b-9957-4867-abb0-858542f5319c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.898871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77761f3-e79e-4871-94ab-1e0be9c2b18a None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:56.912766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.913714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.914074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.914482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.916323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] RBAC: Authorizing `identity:get_project(project_id=31288be8014a459a864d6f0057752d6e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:56.918583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:56.921208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 552/1096] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/projects/31288be8014a459a864d6f0057752d6e => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:37:56.928012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.937354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:56.937997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:56.938260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:56.938554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:56.939194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:56.939499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:56.940941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:56.953431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 545/1097] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:56.959076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:56.961183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:57.031977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c42d-3d65-44df-aff5-e0b394736b23 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:57.053357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:57.056252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a048d32-d87a-4b5b-a4e7-8412636d2635 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:57.065667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:57.066273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:57.066547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:57.066813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:57.067542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=31288be8014a459a864d6f0057752d6e, user.id=bb9bdac9bd62456788d0ec6bdf491000) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:57.067846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:57.069413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:57.075220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 553/1098] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/role_assignments?user.id=bb9bdac9bd62456788d0ec6bdf491000&scope.project.id=31288be8014a459a864d6f0057752d6e&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:57.091963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:57.092620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:57.092901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:57.093204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:57.101546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:57.103059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:37:57.116851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:57.118111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:37:57.119053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 546/1099] 10.222.0.13 () {56 vars in 1093 bytes} [Sat Sep 3 03:37:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:57.124326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:57.227861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:57.234657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fab38-4e01-4eed-af99-12f372df5bd8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:57.269345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:57.269955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:57.270246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:57.270519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:57.271316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:57.271622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:57.273263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:57.291320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 554/1100] 10.222.0.13 () {56 vars in 1133 bytes} [Sat Sep 3 03:37:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:57.297169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:57.402432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f52db7-425f-4b74-869f-fb0ec6edaa05 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:57.443131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:57.443978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:57.444263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:57.444536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:57.476202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:57.520031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:57.521624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:57.628576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 547/1101] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:37:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:37:57.635083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:57.740389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fe5d5-787b-478d-80a7-b1fbfa47519f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:57.777059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:57.777699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:57.778007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:57.778259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:57.789323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:57.790780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:37:57.805826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:57.806839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:37:57.807713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:37:57.807713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:37:57.807713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:57.807713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 555/1102] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:57.813093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:57.875602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:57.916881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81407a0-c6d2-40e9-ac03-8aed4f82781f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:57.951915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:57.952515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:57.952791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:57.953093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:57.953730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:57.954028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:57.955387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:57.967163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 548/1103] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:57.973083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:57.982862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:58.078881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bba30-2183-44e6-88a4-fdb0b7c3351e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:58.115181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:58.115831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:58.116117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:58.116387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:58.123323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:58.124798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:37:58.136390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:37:58.137331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:37:58.138512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 556/1104] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:37:58.143620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:58.254825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbd32f-2ea1-44b5-9f1d-d0b317dd77dd None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:58.274649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:58.290636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558e5d8-8eac-45e4-8904-bcb02f7dc8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:58.291243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558e5d8-8eac-45e4-8904-bcb02f7dc8a4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:58.291525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558e5d8-8eac-45e4-8904-bcb02f7dc8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:58.291798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558e5d8-8eac-45e4-8904-bcb02f7dc8a4 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:58.292485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558e5d8-8eac-45e4-8904-bcb02f7dc8a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:58.292794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558e5d8-8eac-45e4-8904-bcb02f7dc8a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:58.294257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558e5d8-8eac-45e4-8904-bcb02f7dc8a4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:58.306414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 549/1105] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:58.312702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:58.380940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:58.418800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c818fa-a842-44f6-8a5b-b694981f97dd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:58.452960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432b0f1-9c62-47a2-9fbf-9b0e0524203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:58.453581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432b0f1-9c62-47a2-9fbf-9b0e0524203e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:58.453851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432b0f1-9c62-47a2-9fbf-9b0e0524203e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:58.454118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432b0f1-9c62-47a2-9fbf-9b0e0524203e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:58.454839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432b0f1-9c62-47a2-9fbf-9b0e0524203e None admin] RBAC: Adding query filter params (role.id=60fc0b3d025240d8ab843778145cd94e, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=b74a8d0579ba402c8f64fa7a6bb24658) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:37:58.455142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432b0f1-9c62-47a2-9fbf-9b0e0524203e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:58.456598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432b0f1-9c62-47a2-9fbf-9b0e0524203e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:58.462588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 557/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:37:58 2022] GET /identity/v3/role_assignments?user.id=b74a8d0579ba402c8f64fa7a6bb24658&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=60fc0b3d025240d8ab843778145cd94e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:59.051512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5a7d-ce6b-442e-bb3c-edf7de90e515 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:59.052053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5a7d-ce6b-442e-bb3c-edf7de90e515 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:59.052053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d5a7d-ce6b-442e-bb3c-edf7de90e515 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:59.053453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 550/1107] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:37:59.058913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2673c66-188c-4a7a-8ab0-cc1ddfa0e664 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:59.059353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2673c66-188c-4a7a-8ab0-cc1ddfa0e664 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:59.059461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2673c66-188c-4a7a-8ab0-cc1ddfa0e664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:59.079316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f2673c66-188c-4a7a-8ab0-cc1ddfa0e664 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:37:59.080537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f2673c66-188c-4a7a-8ab0-cc1ddfa0e664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:37:59.153123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 558/1108] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:37:59.423997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5a7d-ce6b-442e-bb3c-edf7de90e515 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:59.549560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d5a7d-ce6b-442e-bb3c-edf7de90e515 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:59.586389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23c805-a909-4c1e-b3c2-d1e97181fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:59.587006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c805-a909-4c1e-b3c2-d1e97181fe5b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:59.587279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c805-a909-4c1e-b3c2-d1e97181fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:59.587546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c805-a909-4c1e-b3c2-d1e97181fe5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:59.588756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23c805-a909-4c1e-b3c2-d1e97181fe5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:59.590221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23c805-a909-4c1e-b3c2-d1e97181fe5b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:59.591786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 551/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:37:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:37:59.600690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2673c66-188c-4a7a-8ab0-cc1ddfa0e664 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:37:59.663798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:37:59.707069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2673c66-188c-4a7a-8ab0-cc1ddfa0e664 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:37:59.742221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72242d-5af3-40b9-8be1-d53ac520d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:37:59.742813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72242d-5af3-40b9-8be1-d53ac520d929 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:37:59.743089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72242d-5af3-40b9-8be1-d53ac520d929 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:37:59.743350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72242d-5af3-40b9-8be1-d53ac520d929 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:37:59.743983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72242d-5af3-40b9-8be1-d53ac520d929 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:37:59.745454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72242d-5af3-40b9-8be1-d53ac520d929 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:37:59.772267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 559/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:37:59 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:38:01.713762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdd25c-a158-4c76-bdcb-877da828418f None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:01.714342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdd25c-a158-4c76-bdcb-877da828418f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:01.714342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdd25c-a158-4c76-bdcb-877da828418f None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:01.715666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 552/1111] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:01.721914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732a5f-f0e6-4644-9538-5fdaff8328e6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:01.722662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732a5f-f0e6-4644-9538-5fdaff8328e6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:01.722792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732a5f-f0e6-4644-9538-5fdaff8328e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:01.745093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4c732a5f-f0e6-4644-9538-5fdaff8328e6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:01.746296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4c732a5f-f0e6-4644-9538-5fdaff8328e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:01.824593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 560/1112] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:02.089060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdd25c-a158-4c76-bdcb-877da828418f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:02.146615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:02.210518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdd25c-a158-4c76-bdcb-877da828418f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:02.245382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:02.246005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:02.246276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:02.246542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] PATH_INFO: `/v3/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:02.248047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] RBAC: Authorizing `identity:get_role(role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:02.249438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:02.250764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 553/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:02 2022] GET /identity/v3/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:02.257532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c732a5f-f0e6-4644-9538-5fdaff8328e6 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:02.310590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:02.368714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c732a5f-f0e6-4644-9538-5fdaff8328e6 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:02.404093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:02.404710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:02.404991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:02.405294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] PATH_INFO: `/v3/users/0664eb719ea740188d1e149fb1ca70da` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:02.419070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] RBAC: Authorizing `identity:get_user(user_id=0664eb719ea740188d1e149fb1ca70da)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:02.420511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:02.422132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 561/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:02 2022] GET /identity/v3/users/0664eb719ea740188d1e149fb1ca70da => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:02.428193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:02.535338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763dfd6-e4d9-4cc5-b346-cbcd1cb617da None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:02.554862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:02.575515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:02.576111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:02.576391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:02.576669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:02.652931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:02.654392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:02.754597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 554/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:38:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:38:02.763383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:02.877447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ee1ad-e01a-48f5-b35f-7ffb58be5b28 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:02.879774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:02.913192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c6bc1-5e62-406b-ad70-bfc61b4cd49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:02.913747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c6bc1-5e62-406b-ad70-bfc61b4cd49b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:02.914020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c6bc1-5e62-406b-ad70-bfc61b4cd49b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:02.914287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c6bc1-5e62-406b-ad70-bfc61b4cd49b None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:02.915471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c6bc1-5e62-406b-ad70-bfc61b4cd49b None admin] RBAC: Authorizing `identity:get_project(project_id=31288be8014a459a864d6f0057752d6e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:02.916940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c6bc1-5e62-406b-ad70-bfc61b4cd49b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:02.918554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 562/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:02 2022] GET /identity/v3/projects/31288be8014a459a864d6f0057752d6e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:02.928028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:02.946251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:03.037836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7ea32-d292-44c7-9e11-3825d6d73dc6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:03.074284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6043b3-3d92-4f1e-a81c-4d040aa30950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:03.074882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6043b3-3d92-4f1e-a81c-4d040aa30950 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:03.075160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6043b3-3d92-4f1e-a81c-4d040aa30950 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:03.075434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6043b3-3d92-4f1e-a81c-4d040aa30950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:03.076154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6043b3-3d92-4f1e-a81c-4d040aa30950 None admin] RBAC: Adding query filter params (role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=31288be8014a459a864d6f0057752d6e, user.id=0664eb719ea740188d1e149fb1ca70da) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:03.076460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6043b3-3d92-4f1e-a81c-4d040aa30950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:03.077913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6043b3-3d92-4f1e-a81c-4d040aa30950 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:03.083462 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 555/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:38:02 2022] GET /identity/v3/role_assignments?user.id=0664eb719ea740188d1e149fb1ca70da&scope.project.id=31288be8014a459a864d6f0057752d6e&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:04.974886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ec863-6141-4606-a38e-168786c8db0e None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:04.975506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ec863-6141-4606-a38e-168786c8db0e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:04.975506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ec863-6141-4606-a38e-168786c8db0e None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:04.976783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 563/1118] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:04.983057 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2be4f-63a7-4670-a347-0aadb6950f86 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:04.983949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2be4f-63a7-4670-a347-0aadb6950f86 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:04.983949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2be4f-63a7-4670-a347-0aadb6950f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:05.005777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-eab2be4f-63a7-4670-a347-0aadb6950f86 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:05.007104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-eab2be4f-63a7-4670-a347-0aadb6950f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:05.089652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 556/1119] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:05.357002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ec863-6141-4606-a38e-168786c8db0e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:05.478122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ec863-6141-4606-a38e-168786c8db0e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:05.514487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:05.515106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:05.515386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:05.515655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] PATH_INFO: `/v3/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:05.517206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] RBAC: Authorizing `identity:get_role(role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:05.518587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:05.519912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 564/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:05 2022] GET /identity/v3/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:05.526657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2be4f-63a7-4670-a347-0aadb6950f86 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:05.544826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:05.637480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2be4f-63a7-4670-a347-0aadb6950f86 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:05.675133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:05.675768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:05.676073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:05.676340 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] PATH_INFO: `/v3/users/0664eb719ea740188d1e149fb1ca70da` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:05.678101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] RBAC: Authorizing `identity:get_user(user_id=0664eb719ea740188d1e149fb1ca70da)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:05.679557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:05.681189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 557/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:05 2022] GET /identity/v3/users/0664eb719ea740188d1e149fb1ca70da => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:05.690495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:05.742069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:05.803326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdd0df-97ff-4bc5-83ce-a39eb4f49341 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:05.839216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d41796-1df9-426c-b87d-38698cd4c967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:05.839832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41796-1df9-426c-b87d-38698cd4c967 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:05.840109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41796-1df9-426c-b87d-38698cd4c967 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:05.840384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41796-1df9-426c-b87d-38698cd4c967 None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:05.841634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d41796-1df9-426c-b87d-38698cd4c967 None admin] RBAC: Authorizing `identity:get_project(project_id=31288be8014a459a864d6f0057752d6e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:05.843078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d41796-1df9-426c-b87d-38698cd4c967 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:05.844698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 565/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:05 2022] GET /identity/v3/projects/31288be8014a459a864d6f0057752d6e => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:05.851324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:05.944273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:05.970526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a812e2-9015-4bb3-93e6-b11e3afbbf14 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:06.012760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18c30f-308d-4607-b9a6-2799f794177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:06.013419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c30f-308d-4607-b9a6-2799f794177f None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:06.013724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c30f-308d-4607-b9a6-2799f794177f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:06.014002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18c30f-308d-4607-b9a6-2799f794177f None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e/users/0664eb719ea740188d1e149fb1ca70da/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:06.016366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18c30f-308d-4607-b9a6-2799f794177f None admin] RBAC: Authorizing `identity:create_grant(project_id=31288be8014a459a864d6f0057752d6e, user_id=0664eb719ea740188d1e149fb1ca70da, role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:06.017848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18c30f-308d-4607-b9a6-2799f794177f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:06.033391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 558/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:38:05 2022] PUT /identity/v3/projects/31288be8014a459a864d6f0057752d6e/users/0664eb719ea740188d1e149fb1ca70da/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:38:07.912891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594082c-5985-45c0-a34b-86c8144a3f62 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:07.913814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594082c-5985-45c0-a34b-86c8144a3f62 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:07.913814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594082c-5985-45c0-a34b-86c8144a3f62 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:07.916047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 566/1124] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:07.925210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21f21-b514-443c-ba23-bf1df22c3bdf None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:07.925968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21f21-b514-443c-ba23-bf1df22c3bdf None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:07.926133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21f21-b514-443c-ba23-bf1df22c3bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:07.945803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7cd21f21-b514-443c-ba23-bf1df22c3bdf None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:07.946985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7cd21f21-b514-443c-ba23-bf1df22c3bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:08.016526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 559/1125] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:08.286258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594082c-5985-45c0-a34b-86c8144a3f62 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:08.396296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594082c-5985-45c0-a34b-86c8144a3f62 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:08.406425 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:08.436445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:08.437097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:08.437370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:08.437642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] PATH_INFO: `/v3/roles/a98e3463183b4ff2930adefe3a8b45a4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:08.439088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] RBAC: Authorizing `identity:get_role(role_id=a98e3463183b4ff2930adefe3a8b45a4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:08.440453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:08.441786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 567/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:08 2022] GET /identity/v3/roles/a98e3463183b4ff2930adefe3a8b45a4 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:08.448052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd21f21-b514-443c-ba23-bf1df22c3bdf None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:08.517750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:08.552127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd21f21-b514-443c-ba23-bf1df22c3bdf None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:08.588194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:08.588828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:08.589143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:08.589417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] PATH_INFO: `/v3/users/0664eb719ea740188d1e149fb1ca70da` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:08.590678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] RBAC: Authorizing `identity:get_user(user_id=0664eb719ea740188d1e149fb1ca70da)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:08.592117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:08.593762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 560/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:08 2022] GET /identity/v3/users/0664eb719ea740188d1e149fb1ca70da => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:08.601246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:08.715997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437073b-8510-4405-b7e3-e52ed6c3cfcd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:08.752412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:08.753029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:08.753309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:08.753580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:08.799860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:08.836281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:08.837696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:08.940411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 568/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:38:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:38:08.947065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:09.050696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153afffc-ca7b-4c57-8ba7-e829ebc37ebb None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:09.089343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578afe4f-9479-4515-b9ff-63b4c3d61dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:09.089878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578afe4f-9479-4515-b9ff-63b4c3d61dee None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:09.090159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578afe4f-9479-4515-b9ff-63b4c3d61dee None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:09.090575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578afe4f-9479-4515-b9ff-63b4c3d61dee None admin] PATH_INFO: `/v3/projects/31288be8014a459a864d6f0057752d6e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:09.091803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578afe4f-9479-4515-b9ff-63b4c3d61dee None admin] RBAC: Authorizing `identity:get_project(project_id=31288be8014a459a864d6f0057752d6e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:09.093352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578afe4f-9479-4515-b9ff-63b4c3d61dee None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:09.094975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 561/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:08 2022] GET /identity/v3/projects/31288be8014a459a864d6f0057752d6e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:09.102937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:09.181955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:09.211715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda5d85-384e-4144-a127-951169fce0d8 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:09.250038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c34b7e-ecc9-4085-8a6b-88479f2749ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:09.250641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c34b7e-ecc9-4085-8a6b-88479f2749ad None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:09.250898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c34b7e-ecc9-4085-8a6b-88479f2749ad None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:09.251201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c34b7e-ecc9-4085-8a6b-88479f2749ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:09.251918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c34b7e-ecc9-4085-8a6b-88479f2749ad None admin] RBAC: Adding query filter params (role.id=a98e3463183b4ff2930adefe3a8b45a4, scope.project.id=31288be8014a459a864d6f0057752d6e, user.id=0664eb719ea740188d1e149fb1ca70da) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:09.252228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c34b7e-ecc9-4085-8a6b-88479f2749ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:09.253694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c34b7e-ecc9-4085-8a6b-88479f2749ad None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:09.259976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 569/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:38:09 2022] GET /identity/v3/role_assignments?user.id=0664eb719ea740188d1e149fb1ca70da&scope.project.id=31288be8014a459a864d6f0057752d6e&role.id=a98e3463183b4ff2930adefe3a8b45a4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:38:11.192492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a1427-f3b4-4769-ae11-696f9561e2c5 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:11.193245 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a1427-f3b4-4769-ae11-696f9561e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:11.193245 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a1427-f3b4-4769-ae11-696f9561e2c5 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:11.194395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 562/1131] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:11.200803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be956-ff27-4e16-9566-f2d51e9ac86a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:11.201278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be956-ff27-4e16-9566-f2d51e9ac86a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:11.201375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be956-ff27-4e16-9566-f2d51e9ac86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:11.224033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b15be956-ff27-4e16-9566-f2d51e9ac86a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:11.225249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b15be956-ff27-4e16-9566-f2d51e9ac86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:11.301143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 570/1132] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:11.578595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a1427-f3b4-4769-ae11-696f9561e2c5 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:11.585044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:11.705679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a1427-f3b4-4769-ae11-696f9561e2c5 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:11.741911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fcf07-56c1-45dd-bcb4-ed8f267bd06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:11.742530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fcf07-56c1-45dd-bcb4-ed8f267bd06f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:11.742804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fcf07-56c1-45dd-bcb4-ed8f267bd06f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:11.743068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fcf07-56c1-45dd-bcb4-ed8f267bd06f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:11.744216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fcf07-56c1-45dd-bcb4-ed8f267bd06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:11.745675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fcf07-56c1-45dd-bcb4-ed8f267bd06f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:11.747230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 563/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:11.753599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15be956-ff27-4e16-9566-f2d51e9ac86a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:11.824240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:11.861440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15be956-ff27-4e16-9566-f2d51e9ac86a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:11.897109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f599-5cf3-4d9c-a517-c4ea0bcf1273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:11.897712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f599-5cf3-4d9c-a517-c4ea0bcf1273 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:11.897994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f599-5cf3-4d9c-a517-c4ea0bcf1273 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:11.898263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f599-5cf3-4d9c-a517-c4ea0bcf1273 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:11.898921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f599-5cf3-4d9c-a517-c4ea0bcf1273 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:11.900363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f599-5cf3-4d9c-a517-c4ea0bcf1273 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:11.932137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 571/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:38:11 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:38:13.842680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1b3ee-5643-419d-968e-ffbc4b981ce1 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:13.843598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1b3ee-5643-419d-968e-ffbc4b981ce1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:13.843598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1b3ee-5643-419d-968e-ffbc4b981ce1 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:13.845799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 564/1135] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:13.852594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53a3e-ec98-4f27-af64-e3058e1e246c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:13.853055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53a3e-ec98-4f27-af64-e3058e1e246c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:13.853169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde53a3e-ec98-4f27-af64-e3058e1e246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:13.882340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-cde53a3e-ec98-4f27-af64-e3058e1e246c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:13.883536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cde53a3e-ec98-4f27-af64-e3058e1e246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:13.954325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 572/1136] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:14.222951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1b3ee-5643-419d-968e-ffbc4b981ce1 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:14.309593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:14.340642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1b3ee-5643-419d-968e-ffbc4b981ce1 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:14.376408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368c090-7293-4d13-814d-c42a977f16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:14.377051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c090-7293-4d13-814d-c42a977f16db None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:14.377330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c090-7293-4d13-814d-c42a977f16db None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:14.377595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368c090-7293-4d13-814d-c42a977f16db None admin] PATH_INFO: `/v3/domains/default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:14.378814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368c090-7293-4d13-814d-c42a977f16db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:14.380252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368c090-7293-4d13-814d-c42a977f16db None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:14.381874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 565/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:14.390790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53a3e-ec98-4f27-af64-e3058e1e246c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:14.451586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:14.505051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde53a3e-ec98-4f27-af64-e3058e1e246c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:14.540595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f49a-45e2-4183-9bc6-9b9ad6d61b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:14.541229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f49a-45e2-4183-9bc6-9b9ad6d61b83 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:14.541511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f49a-45e2-4183-9bc6-9b9ad6d61b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:14.541793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f49a-45e2-4183-9bc6-9b9ad6d61b83 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:14.542439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f49a-45e2-4183-9bc6-9b9ad6d61b83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:14.543884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f49a-45e2-4183-9bc6-9b9ad6d61b83 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:14.568724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 573/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:38:14 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:38:16.483538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e11c-7210-4406-9b88-96a43906e861 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:16.484402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e11c-7210-4406-9b88-96a43906e861 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:16.484402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e11c-7210-4406-9b88-96a43906e861 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:16.486900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 566/1139] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:16.493534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fbdb8-cac3-4196-a553-e07224262acd None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:16.493985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fbdb8-cac3-4196-a553-e07224262acd None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:16.494091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fbdb8-cac3-4196-a553-e07224262acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:16.523298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2c7fbdb8-cac3-4196-a553-e07224262acd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:16.524494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2c7fbdb8-cac3-4196-a553-e07224262acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:16.599381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 574/1140] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:16.876405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6e11c-7210-4406-9b88-96a43906e861 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:16.990585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6e11c-7210-4406-9b88-96a43906e861 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:17.026753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:17.027370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:17.027649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:17.027924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:17.036274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:17.039283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:38:17.044565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:38:17.048984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:38:17.050173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 567/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:38:17.052382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fbdb8-cac3-4196-a553-e07224262acd None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:17.098191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:17.166863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fbdb8-cac3-4196-a553-e07224262acd None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:17.205067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:17.205638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:17.205946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:17.206215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:17.206884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:17.207185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:17.208960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:17.216936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 575/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:17.222966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:17.325543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3fa88-cc72-40e1-8268-dc28de1d2ba5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:17.361832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:17.362443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:17.362721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:17.362993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] PATH_INFO: `/v3/users/f399b9e14389453bbab8984319254fe6` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:17.380466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] RBAC: Authorizing `identity:get_user(user_id=f399b9e14389453bbab8984319254fe6)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:17.381945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:17.383588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 568/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:17 2022] GET /identity/v3/users/f399b9e14389453bbab8984319254fe6 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:38:17.390496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:17.501401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:17.504422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af709d7-ccb4-443e-b572-f3d01f6eabee None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:17.541401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:17.541991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:17.542262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:17.542531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:17.622702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:17.624144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:17.725934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:17.729834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 576/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:38:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:38:17.736433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:17.802558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:17.845738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960df39-1ea4-42c5-955f-bdb72cdc04ef None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:17.881275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636de2d7-6373-4066-9e63-d8a761f1b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:17.881896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636de2d7-6373-4066-9e63-d8a761f1b09c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:17.882180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636de2d7-6373-4066-9e63-d8a761f1b09c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:17.882452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636de2d7-6373-4066-9e63-d8a761f1b09c None admin] PATH_INFO: `/v3/projects/c8e8ea907bd1489fb200edb9728d8b22` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:17.883608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636de2d7-6373-4066-9e63-d8a761f1b09c None admin] RBAC: Authorizing `identity:get_project(project_id=c8e8ea907bd1489fb200edb9728d8b22)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:17.885059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636de2d7-6373-4066-9e63-d8a761f1b09c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:17.886683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 569/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:17 2022] GET /identity/v3/projects/c8e8ea907bd1489fb200edb9728d8b22 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:17.893181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:18.002437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933f13a-bc8c-479e-82f3-ccf3bf7f6d25 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:18.038062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ae911-a479-494f-859a-e5ffdb22116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:18.038652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ae911-a479-494f-859a-e5ffdb22116e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:18.038927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ae911-a479-494f-859a-e5ffdb22116e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:18.039195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ae911-a479-494f-859a-e5ffdb22116e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:18.039880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ae911-a479-494f-859a-e5ffdb22116e None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=c8e8ea907bd1489fb200edb9728d8b22, user.id=f399b9e14389453bbab8984319254fe6) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:18.040209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ae911-a479-494f-859a-e5ffdb22116e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:18.041658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ae911-a479-494f-859a-e5ffdb22116e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:18.048406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 577/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:38:17 2022] GET /identity/v3/role_assignments?user.id=f399b9e14389453bbab8984319254fe6&scope.project.id=c8e8ea907bd1489fb200edb9728d8b22&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:19.904019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb9f0-0092-45c0-80c8-38caa0efe139 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:19.904867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb9f0-0092-45c0-80c8-38caa0efe139 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:19.904867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bb9f0-0092-45c0-80c8-38caa0efe139 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:19.907022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 570/1147] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:19.912605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f241d7-8a67-4bc5-8dba-271b1d8836d9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:19.913055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f241d7-8a67-4bc5-8dba-271b1d8836d9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:19.913141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f241d7-8a67-4bc5-8dba-271b1d8836d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:19.932666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c0f241d7-8a67-4bc5-8dba-271b1d8836d9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:19.933889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c0f241d7-8a67-4bc5-8dba-271b1d8836d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:19.996070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:20.006080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 578/1148] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:20.270530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb9f0-0092-45c0-80c8-38caa0efe139 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:20.401660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bb9f0-0092-45c0-80c8-38caa0efe139 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:20.434786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:20.446195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:20.446821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:20.447099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:20.447371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:20.458148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:38:20.462923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:38:20.463939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:38:20.464859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 571/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:38:20.473081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f241d7-8a67-4bc5-8dba-271b1d8836d9 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:20.589058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f241d7-8a67-4bc5-8dba-271b1d8836d9 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:20.627112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:20.627999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:20.628428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:20.628853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:20.630094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:20.630575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:20.631954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:20.641270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 579/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:20.647285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:20.762430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda6d7-44ee-4807-b617-64f0c8843c68 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:20.798314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:20.798943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:20.799223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:20.799498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] PATH_INFO: `/v3/users/f399b9e14389453bbab8984319254fe6` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:20.800744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] RBAC: Authorizing `identity:get_user(user_id=f399b9e14389453bbab8984319254fe6)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:20.802287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:20.803872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 572/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:20 2022] GET /identity/v3/users/f399b9e14389453bbab8984319254fe6 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:20.813201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:20.882984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:20.931797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90bf9-80f6-475b-9bd8-01297200c9d5 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:20.970649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff9f7f-cef8-4015-952a-f29b22791f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:20.971356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff9f7f-cef8-4015-952a-f29b22791f51 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:20.971638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff9f7f-cef8-4015-952a-f29b22791f51 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:20.971910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff9f7f-cef8-4015-952a-f29b22791f51 None admin] PATH_INFO: `/v3/projects/c8e8ea907bd1489fb200edb9728d8b22` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:20.973082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff9f7f-cef8-4015-952a-f29b22791f51 None admin] RBAC: Authorizing `identity:get_project(project_id=c8e8ea907bd1489fb200edb9728d8b22)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:20.975355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff9f7f-cef8-4015-952a-f29b22791f51 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:20.977999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 580/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:20 2022] GET /identity/v3/projects/c8e8ea907bd1489fb200edb9728d8b22 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:20.985525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:21.051854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:21.101283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec35d18-89bb-499d-83ce-7669363bf8ca None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:21.146173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ff2e-51a0-4185-b22e-b43c865935df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:21.146977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ff2e-51a0-4185-b22e-b43c865935df None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:21.147273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ff2e-51a0-4185-b22e-b43c865935df None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:21.147539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ff2e-51a0-4185-b22e-b43c865935df None admin] PATH_INFO: `/v3/projects/c8e8ea907bd1489fb200edb9728d8b22/users/f399b9e14389453bbab8984319254fe6/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:21.149752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ff2e-51a0-4185-b22e-b43c865935df None admin] RBAC: Authorizing `identity:create_grant(project_id=c8e8ea907bd1489fb200edb9728d8b22, user_id=f399b9e14389453bbab8984319254fe6, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:21.151189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ff2e-51a0-4185-b22e-b43c865935df None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:21.166742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 573/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:38:20 2022] PUT /identity/v3/projects/c8e8ea907bd1489fb200edb9728d8b22/users/f399b9e14389453bbab8984319254fe6/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:38:23.041186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd40d3-a71e-40a9-9ba7-7be2fb9e3048 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:23.042096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd40d3-a71e-40a9-9ba7-7be2fb9e3048 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:23.042096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd40d3-a71e-40a9-9ba7-7be2fb9e3048 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:23.044199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 581/1154] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:23.050376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1400-d2cd-42d4-93ab-275f92a8d8b2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:23.050809 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1400-d2cd-42d4-93ab-275f92a8d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:23.050917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1400-d2cd-42d4-93ab-275f92a8d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:23.069749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-444e1400-d2cd-42d4-93ab-275f92a8d8b2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:23.070933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-444e1400-d2cd-42d4-93ab-275f92a8d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:23.154089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 574/1155] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:23.425318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd40d3-a71e-40a9-9ba7-7be2fb9e3048 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:23.539377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd40d3-a71e-40a9-9ba7-7be2fb9e3048 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:23.562742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:23.574858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:23.575478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:23.575757 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:23.576016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:23.586420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:38:23.591220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:38:23.592982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:38:23.594044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 582/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:38:23.599975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e1400-d2cd-42d4-93ab-275f92a8d8b2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:23.655517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:23.727211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e1400-d2cd-42d4-93ab-275f92a8d8b2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:23.770415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:23.771010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:23.771304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:23.771570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:23.772226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:23.772533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:23.773941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:23.782097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 575/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:23.788901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:23.897153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999f678-4de7-4558-9ca2-d521b7cb8c95 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:23.932179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:23.932786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:23.933094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:23.933361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] PATH_INFO: `/v3/users/f399b9e14389453bbab8984319254fe6` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:23.934503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] RBAC: Authorizing `identity:get_user(user_id=f399b9e14389453bbab8984319254fe6)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:23.935942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:23.937555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 583/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:23 2022] GET /identity/v3/users/f399b9e14389453bbab8984319254fe6 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:23.946918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:24.055291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f4640-b858-44f4-b03a-a1857dfbc4de None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:24.062218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:24.090158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:24.090751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:24.091028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:24.091308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:24.160378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:24.161901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:24.277121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 576/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:38:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:38:24.283340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:24.336405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:24.389624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bfa33-a707-4cce-bf4f-d31b180ed412 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:24.428627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a7f4b-2ead-4599-9cc4-38d12a12aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:24.429278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a7f4b-2ead-4599-9cc4-38d12a12aa23 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:24.429555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a7f4b-2ead-4599-9cc4-38d12a12aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:24.429827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a7f4b-2ead-4599-9cc4-38d12a12aa23 None admin] PATH_INFO: `/v3/projects/c8e8ea907bd1489fb200edb9728d8b22` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:24.430993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a7f4b-2ead-4599-9cc4-38d12a12aa23 None admin] RBAC: Authorizing `identity:get_project(project_id=c8e8ea907bd1489fb200edb9728d8b22)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:24.432449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a7f4b-2ead-4599-9cc4-38d12a12aa23 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:24.434114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 584/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:24 2022] GET /identity/v3/projects/c8e8ea907bd1489fb200edb9728d8b22 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:24.440486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:24.449166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:24.543293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df89e7-cfdc-4579-9408-964dc7c3fd02 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:24.578575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd7163-f446-4476-b90a-359f03525f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:24.579165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7163-f446-4476-b90a-359f03525f1c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:24.579442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7163-f446-4476-b90a-359f03525f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:24.579709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd7163-f446-4476-b90a-359f03525f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:24.580419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd7163-f446-4476-b90a-359f03525f1c None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=c8e8ea907bd1489fb200edb9728d8b22, user.id=f399b9e14389453bbab8984319254fe6) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:24.580717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd7163-f446-4476-b90a-359f03525f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:24.582190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd7163-f446-4476-b90a-359f03525f1c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:24.588129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 577/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:38:24 2022] GET /identity/v3/role_assignments?user.id=f399b9e14389453bbab8984319254fe6&scope.project.id=c8e8ea907bd1489fb200edb9728d8b22&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:38:26.485460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770fa95-4337-4ba5-bbd9-29a11f8f1cfb None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:26.486334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770fa95-4337-4ba5-bbd9-29a11f8f1cfb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:26.486334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770fa95-4337-4ba5-bbd9-29a11f8f1cfb None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:26.487601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 585/1162] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:26.494207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede6a3-4cd3-450b-ab4c-b7747aef9866 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:26.494931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede6a3-4cd3-450b-ab4c-b7747aef9866 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:26.495118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede6a3-4cd3-450b-ab4c-b7747aef9866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:26.519916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ceede6a3-4cd3-450b-ab4c-b7747aef9866 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:26.521153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ceede6a3-4cd3-450b-ab4c-b7747aef9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:26.588831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:26.594125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 578/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:26.861984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770fa95-4337-4ba5-bbd9-29a11f8f1cfb None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:26.974978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770fa95-4337-4ba5-bbd9-29a11f8f1cfb None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:27.001647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:27.024859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:27.025509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:27.025788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:27.026056 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:27.093465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:27.094960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:27.201508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 586/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:38:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:38:27.210463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceede6a3-4cd3-450b-ab4c-b7747aef9866 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:27.318967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceede6a3-4cd3-450b-ab4c-b7747aef9866 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:27.353610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367e5a5-30a3-4945-b16c-ca81ac71fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:27.354225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e5a5-30a3-4945-b16c-ca81ac71fd8a None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:27.354503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e5a5-30a3-4945-b16c-ca81ac71fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:27.354768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367e5a5-30a3-4945-b16c-ca81ac71fd8a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:27.361795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367e5a5-30a3-4945-b16c-ca81ac71fd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:27.363235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367e5a5-30a3-4945-b16c-ca81ac71fd8a None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-8367e5a5-30a3-4945-b16c-ca81ac71fd8a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:38:27.374969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:38:27.376138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:38:27.377411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 579/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:38:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:38:27.383141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:27.405818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:27.486934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1d82c-635c-4719-98e6-24ea87835bae None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:27.524502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad218f-5e61-4929-aeda-51399d03e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:27.525133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad218f-5e61-4929-aeda-51399d03e89d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:27.525411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad218f-5e61-4929-aeda-51399d03e89d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:27.525685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad218f-5e61-4929-aeda-51399d03e89d None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:27.526319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad218f-5e61-4929-aeda-51399d03e89d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:27.526624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad218f-5e61-4929-aeda-51399d03e89d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:27.527991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad218f-5e61-4929-aeda-51399d03e89d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:27.535173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 587/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Sat Sep 3 03:38:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:29.392054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b3f8-849e-4ed1-901c-a848a3869199 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:29.392636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b3f8-849e-4ed1-901c-a848a3869199 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:29.392636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929b3f8-849e-4ed1-901c-a848a3869199 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:29.394019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 580/1167] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:29.400422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470e5b-7184-42e6-895f-eba99c125697 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:29.401191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470e5b-7184-42e6-895f-eba99c125697 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:29.401340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470e5b-7184-42e6-895f-eba99c125697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:29.425920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ae470e5b-7184-42e6-895f-eba99c125697 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:29.427316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ae470e5b-7184-42e6-895f-eba99c125697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:29.505581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 588/1168] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:29.784853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929b3f8-849e-4ed1-901c-a848a3869199 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:29.848219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:29.897547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929b3f8-849e-4ed1-901c-a848a3869199 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:29.932024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d40e99-979e-4c7e-ba73-868b9c2a94c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:29.932612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40e99-979e-4c7e-ba73-868b9c2a94c0 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:29.932889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40e99-979e-4c7e-ba73-868b9c2a94c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:29.933192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d40e99-979e-4c7e-ba73-868b9c2a94c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:29.933844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d40e99-979e-4c7e-ba73-868b9c2a94c0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:29.935202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d40e99-979e-4c7e-ba73-868b9c2a94c0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:29.953761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 581/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Sat Sep 3 03:38:29 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:38:31.889224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f62b-aac8-47a4-80fd-c25e80614b7f None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:31.890065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f62b-aac8-47a4-80fd-c25e80614b7f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:31.890065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f62b-aac8-47a4-80fd-c25e80614b7f None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:31.892211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 589/1170] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:31.901107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e04f-306c-40a3-a101-5465eaf342eb None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:31.901524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e04f-306c-40a3-a101-5465eaf342eb None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:31.901667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120e04f-306c-40a3-a101-5465eaf342eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:31.925330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4120e04f-306c-40a3-a101-5465eaf342eb None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:31.926660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4120e04f-306c-40a3-a101-5465eaf342eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:31.996837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 582/1171] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:32.268692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f62b-aac8-47a4-80fd-c25e80614b7f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:32.291223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:32.388476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f62b-aac8-47a4-80fd-c25e80614b7f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:32.426133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e62558-e712-4e52-97b3-9dfb1a821fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:32.426732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e62558-e712-4e52-97b3-9dfb1a821fd3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:32.427037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e62558-e712-4e52-97b3-9dfb1a821fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:32.427303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e62558-e712-4e52-97b3-9dfb1a821fd3 None admin] PATH_INFO: `/v3/domains/fe2e95de5cee4335be19e8bbdb6e024e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:32.438987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e62558-e712-4e52-97b3-9dfb1a821fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe2e95de5cee4335be19e8bbdb6e024e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:32.440440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e62558-e712-4e52-97b3-9dfb1a821fd3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:32.442220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 590/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Sat Sep 3 03:38:32 2022] GET /identity/v3/domains/fe2e95de5cee4335be19e8bbdb6e024e => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:32.448977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120e04f-306c-40a3-a101-5465eaf342eb None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:32.506600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:32.565321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120e04f-306c-40a3-a101-5465eaf342eb None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:32.605782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfde491-19e7-4007-84dc-9f2784026330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:32.606398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde491-19e7-4007-84dc-9f2784026330 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:32.606673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde491-19e7-4007-84dc-9f2784026330 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:32.606928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde491-19e7-4007-84dc-9f2784026330 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:32.607568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde491-19e7-4007-84dc-9f2784026330 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:32.609026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde491-19e7-4007-84dc-9f2784026330 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:32.638644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 583/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:38:32 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:38:34.557412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff4ca0-5e2a-433b-8a7a-58b2917d1d70 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:34.558037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff4ca0-5e2a-433b-8a7a-58b2917d1d70 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:34.558037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff4ca0-5e2a-433b-8a7a-58b2917d1d70 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:34.559229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 591/1174] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:34.565559 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad0680-a3e7-49e5-976c-1a6e88dc2943 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:34.566312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad0680-a3e7-49e5-976c-1a6e88dc2943 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:34.566442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad0680-a3e7-49e5-976c-1a6e88dc2943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:34.585854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c0ad0680-a3e7-49e5-976c-1a6e88dc2943 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:34.587045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c0ad0680-a3e7-49e5-976c-1a6e88dc2943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:34.667982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 584/1175] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:34.936134 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff4ca0-5e2a-433b-8a7a-58b2917d1d70 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:35.019024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:35.046894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff4ca0-5e2a-433b-8a7a-58b2917d1d70 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:35.083154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63f0e5-923b-4fb1-adf3-f344aa2d46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:35.083776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63f0e5-923b-4fb1-adf3-f344aa2d46a5 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:35.084053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63f0e5-923b-4fb1-adf3-f344aa2d46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:35.084330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63f0e5-923b-4fb1-adf3-f344aa2d46a5 None admin] PATH_INFO: `/v3/domains/fe2e95de5cee4335be19e8bbdb6e024e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:35.085525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63f0e5-923b-4fb1-adf3-f344aa2d46a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe2e95de5cee4335be19e8bbdb6e024e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:35.086973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63f0e5-923b-4fb1-adf3-f344aa2d46a5 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:35.088550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 592/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Sat Sep 3 03:38:34 2022] GET /identity/v3/domains/fe2e95de5cee4335be19e8bbdb6e024e => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:35.094803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad0680-a3e7-49e5-976c-1a6e88dc2943 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:35.129228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:35.203921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad0680-a3e7-49e5-976c-1a6e88dc2943 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:35.243553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a70a6-880e-4eed-9a87-c45c998d4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:35.244146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a70a6-880e-4eed-9a87-c45c998d4728 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:35.244424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a70a6-880e-4eed-9a87-c45c998d4728 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:35.244695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a70a6-880e-4eed-9a87-c45c998d4728 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:35.245376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a70a6-880e-4eed-9a87-c45c998d4728 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:35.246837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a70a6-880e-4eed-9a87-c45c998d4728 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:35.274868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 585/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:38:35 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:38:37.220355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed21f4-3671-4412-a9ed-ae62e0b12c86 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:37.220898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed21f4-3671-4412-a9ed-ae62e0b12c86 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:37.220898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed21f4-3671-4412-a9ed-ae62e0b12c86 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:37.222285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 593/1178] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:37.228999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031c9d5-e3e3-4433-92b6-4c58bafdaacb None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:37.229712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031c9d5-e3e3-4433-92b6-4c58bafdaacb None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:37.229959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031c9d5-e3e3-4433-92b6-4c58bafdaacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:37.253837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1031c9d5-e3e3-4433-92b6-4c58bafdaacb None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:37.255206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1031c9d5-e3e3-4433-92b6-4c58bafdaacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:37.324857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 586/1179] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:37.597318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed21f4-3671-4412-a9ed-ae62e0b12c86 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:37.707739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed21f4-3671-4412-a9ed-ae62e0b12c86 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:37.743848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:37.744463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:37.744745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:37.745021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:37.758233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:38:37.763034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:38:37.764121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:38:37.765048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 594/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:38:37.771148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031c9d5-e3e3-4433-92b6-4c58bafdaacb None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:37.795420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:37.883037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031c9d5-e3e3-4433-92b6-4c58bafdaacb None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:37.917872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:37.918475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:37.918751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:37.919019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:37.919682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:37.919984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:37.921391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:37.930054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 587/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:37.939917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:37.945763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:38.052820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a7f2d-4136-4e8c-9f20-4a6b02300b50 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:38.087967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:38.088579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:38.088855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:38.089155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] PATH_INFO: `/v3/users/4bbcd7735082449886691b6693695170` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:38.102616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] RBAC: Authorizing `identity:get_user(user_id=4bbcd7735082449886691b6693695170)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:38.104057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:38.105674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 595/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:37 2022] GET /identity/v3/users/4bbcd7735082449886691b6693695170 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:38.112959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:38.193999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:38.215312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9eab1-72a9-4723-9586-d30b24b8ec29 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:38.250421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:38.251019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:38.251281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:38.251550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:38.320777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:38.322254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:38.404833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:38.425434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 588/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:38:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:38:38.432416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:38.494707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:38.537771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648ae2e-5fe3-4f8f-924e-6d869b5215a0 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:38.572151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb10b33-d3f8-480f-8cc3-2aa6d7afc57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:38.572769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb10b33-d3f8-480f-8cc3-2aa6d7afc57d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:38.573083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb10b33-d3f8-480f-8cc3-2aa6d7afc57d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:38.573378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb10b33-d3f8-480f-8cc3-2aa6d7afc57d None admin] PATH_INFO: `/v3/projects/40fbad17864249c5b5535b19acd95dd1` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:38.575139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb10b33-d3f8-480f-8cc3-2aa6d7afc57d None admin] RBAC: Authorizing `identity:get_project(project_id=40fbad17864249c5b5535b19acd95dd1)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:38.577382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb10b33-d3f8-480f-8cc3-2aa6d7afc57d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:38.579856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 596/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:38 2022] GET /identity/v3/projects/40fbad17864249c5b5535b19acd95dd1 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:38.589315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:38.705933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4774ca-b059-4dac-8c42-cbbd91431c9c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:38.743497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e5cfb-7496-4651-be05-5927f8998cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:38.744100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5cfb-7496-4651-be05-5927f8998cb9 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:38.744379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5cfb-7496-4651-be05-5927f8998cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:38.744646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e5cfb-7496-4651-be05-5927f8998cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:38.745860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e5cfb-7496-4651-be05-5927f8998cb9 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=40fbad17864249c5b5535b19acd95dd1, user.id=4bbcd7735082449886691b6693695170) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:38.746167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e5cfb-7496-4651-be05-5927f8998cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:38.747594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e5cfb-7496-4651-be05-5927f8998cb9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:38.753471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 589/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:38:38 2022] GET /identity/v3/role_assignments?user.id=4bbcd7735082449886691b6693695170&scope.project.id=40fbad17864249c5b5535b19acd95dd1&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:40.603235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369f744-7e9a-42f3-8c3c-7b67741625b3 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:40.604031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369f744-7e9a-42f3-8c3c-7b67741625b3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:40.604031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369f744-7e9a-42f3-8c3c-7b67741625b3 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:40.606241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 597/1186] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:40.612768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5888783-f135-4f9c-ab18-e46c8eac8780 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:40.613231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5888783-f135-4f9c-ab18-e46c8eac8780 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:40.613393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5888783-f135-4f9c-ab18-e46c8eac8780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:40.638744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a5888783-f135-4f9c-ab18-e46c8eac8780 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:40.639977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a5888783-f135-4f9c-ab18-e46c8eac8780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:40.687861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:40.717191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 590/1187] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:40.987400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369f744-7e9a-42f3-8c3c-7b67741625b3 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:41.119329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369f744-7e9a-42f3-8c3c-7b67741625b3 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:41.145925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:41.154823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:41.155442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:41.155718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:41.155986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:41.166447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:38:41.171194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:38:41.172249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:38:41.173199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 598/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:38:41.178696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5888783-f135-4f9c-ab18-e46c8eac8780 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:41.281546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5888783-f135-4f9c-ab18-e46c8eac8780 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:41.318571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:41.319195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:41.319468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:41.319731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:41.320384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:41.320687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:41.322131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:41.331995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 591/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:41.338121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:41.450440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876828-ac34-401c-b970-c8468c59c45c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:41.495609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:41.496354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:41.496714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:41.497089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] PATH_INFO: `/v3/users/4bbcd7735082449886691b6693695170` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:41.498291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] RBAC: Authorizing `identity:get_user(user_id=4bbcd7735082449886691b6693695170)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:41.499807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:41.506376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 599/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:41 2022] GET /identity/v3/users/4bbcd7735082449886691b6693695170 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:41.507617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:41.542347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:41.609970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2b29e-3b6e-4591-b4b2-fc11da4899cd None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:41.642488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b73db8-4d40-4b18-b502-40266eb51013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:41.643135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b73db8-4d40-4b18-b502-40266eb51013 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:41.643380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b73db8-4d40-4b18-b502-40266eb51013 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:41.643653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b73db8-4d40-4b18-b502-40266eb51013 None admin] PATH_INFO: `/v3/projects/40fbad17864249c5b5535b19acd95dd1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:41.644761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b73db8-4d40-4b18-b502-40266eb51013 None admin] RBAC: Authorizing `identity:get_project(project_id=40fbad17864249c5b5535b19acd95dd1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:41.646257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b73db8-4d40-4b18-b502-40266eb51013 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:41.654424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 592/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:41 2022] GET /identity/v3/projects/40fbad17864249c5b5535b19acd95dd1 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:41.654584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:41.710497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:41.754934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98cda-7db6-4e36-ab65-0bca523bb317 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:41.792092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b8a2b-d713-4695-b337-a2e7c577a5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:41.792822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8a2b-d713-4695-b337-a2e7c577a5a4 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:41.793019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8a2b-d713-4695-b337-a2e7c577a5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:41.793318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8a2b-d713-4695-b337-a2e7c577a5a4 None admin] PATH_INFO: `/v3/projects/40fbad17864249c5b5535b19acd95dd1/users/4bbcd7735082449886691b6693695170/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:41.795457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b8a2b-d713-4695-b337-a2e7c577a5a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=40fbad17864249c5b5535b19acd95dd1, user_id=4bbcd7735082449886691b6693695170, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:41.796933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b8a2b-d713-4695-b337-a2e7c577a5a4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:41.812883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 600/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:38:41 2022] PUT /identity/v3/projects/40fbad17864249c5b5535b19acd95dd1/users/4bbcd7735082449886691b6693695170/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:38:43.650018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a0161-7a78-4ca3-b9a4-94eb3295af4d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:43.650843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a0161-7a78-4ca3-b9a4-94eb3295af4d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:43.650843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a0161-7a78-4ca3-b9a4-94eb3295af4d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:43.653157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 593/1193] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:38:43.659267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78627a-f7b0-4f3b-9ce6-80f35e486560 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:43.660029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78627a-f7b0-4f3b-9ce6-80f35e486560 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:43.660159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78627a-f7b0-4f3b-9ce6-80f35e486560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:43.681816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-5a78627a-f7b0-4f3b-9ce6-80f35e486560 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:38:43.683018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5a78627a-f7b0-4f3b-9ce6-80f35e486560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:38:43.762162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 601/1194] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:38:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:38:44.041545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a0161-7a78-4ca3-b9a4-94eb3295af4d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:44.158953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a0161-7a78-4ca3-b9a4-94eb3295af4d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:44.162087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:44.200260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:44.200874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:44.201182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:44.201449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:44.213080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:38:44.217837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:38:44.218868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:38:44.220545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 594/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:38:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:38:44.228561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78627a-f7b0-4f3b-9ce6-80f35e486560 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:44.283220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:44.343445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a78627a-f7b0-4f3b-9ce6-80f35e486560 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:44.379586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:44.380181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:44.380452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:44.380721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:44.381412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:44.381707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:44.383080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:44.391421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 602/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:44.400249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:44.502901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb661a-f722-4332-9cfa-6dc94a008847 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:44.541489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:44.542395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:44.542768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:44.543115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] PATH_INFO: `/v3/users/4bbcd7735082449886691b6693695170` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:44.545145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] RBAC: Authorizing `identity:get_user(user_id=4bbcd7735082449886691b6693695170)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:44.547382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:44.549979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 595/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Sat Sep 3 03:38:44 2022] GET /identity/v3/users/4bbcd7735082449886691b6693695170 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:44.560058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:44.672267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70e3ef-34ad-41b9-9bae-2debf0cfcf07 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:44.681436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:44.707994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:44.708595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:44.708877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:44.709186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:44.779216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:44.780663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:44.887675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 603/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:38:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:38:44.897004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:44.941187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:45.015409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad7891-e16d-4da7-923c-d81dc8a3e80e None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:45.053475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cc32a-ff23-4feb-9e91-2a25cb59c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:45.054093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cc32a-ff23-4feb-9e91-2a25cb59c542 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:45.054373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cc32a-ff23-4feb-9e91-2a25cb59c542 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:45.054648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cc32a-ff23-4feb-9e91-2a25cb59c542 None admin] PATH_INFO: `/v3/projects/40fbad17864249c5b5535b19acd95dd1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:45.055886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cc32a-ff23-4feb-9e91-2a25cb59c542 None admin] RBAC: Authorizing `identity:get_project(project_id=40fbad17864249c5b5535b19acd95dd1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:45.057345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cc32a-ff23-4feb-9e91-2a25cb59c542 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:45.058986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 596/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Sat Sep 3 03:38:44 2022] GET /identity/v3/projects/40fbad17864249c5b5535b19acd95dd1 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:45.066146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:38:45.077706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:45.179974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782df42e-95e6-46aa-8815-b8b503b1e168 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:38:45.215770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b0be1-5f40-4658-951b-4e9689fff1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:38:45.216304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b0be1-5f40-4658-951b-4e9689fff1a6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:38:45.216579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b0be1-5f40-4658-951b-4e9689fff1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:38:45.216843 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b0be1-5f40-4658-951b-4e9689fff1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:38:45.217599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b0be1-5f40-4658-951b-4e9689fff1a6 None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=40fbad17864249c5b5535b19acd95dd1, user.id=4bbcd7735082449886691b6693695170) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:38:45.217904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b0be1-5f40-4658-951b-4e9689fff1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:38:45.219327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b0be1-5f40-4658-951b-4e9689fff1a6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:38:45.225344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 604/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:38:45 2022] GET /identity/v3/role_assignments?user.id=4bbcd7735082449886691b6693695170&scope.project.id=40fbad17864249c5b5535b19acd95dd1&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:38:55.047613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=50 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:38:55.222661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=64 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:40.633421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb54ed-8574-425d-bdb3-06f01d81156d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:40.634151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb54ed-8574-425d-bdb3-06f01d81156d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:40.634151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb54ed-8574-425d-bdb3-06f01d81156d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:40.635148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 597/1201] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:39:40.640753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89aec3-6060-4976-8922-d93839bb958d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:40.641356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89aec3-6060-4976-8922-d93839bb958d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:40.641356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89aec3-6060-4976-8922-d93839bb958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:40.660491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8b89aec3-6060-4976-8922-d93839bb958d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:39:40.662020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8b89aec3-6060-4976-8922-d93839bb958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:39:40.746954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 605/1202] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:39:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:39:41.025438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb54ed-8574-425d-bdb3-06f01d81156d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:41.158603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb54ed-8574-425d-bdb3-06f01d81156d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:41.203803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:41.204438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:41.204721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:41.205073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:41.217246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:41.218798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:41.236209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:41.237938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:41.239361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:41.239361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:41.239361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:41.241517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 598/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:41.248400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89aec3-6060-4976-8922-d93839bb958d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:41.374175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89aec3-6060-4976-8922-d93839bb958d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:41.414920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:41.425363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a964273-3a9d-4ae8-b85f-326079aa6e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:41.426007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964273-3a9d-4ae8-b85f-326079aa6e14 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:41.426474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964273-3a9d-4ae8-b85f-326079aa6e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:41.426779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a964273-3a9d-4ae8-b85f-326079aa6e14 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:41.427531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a964273-3a9d-4ae8-b85f-326079aa6e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:41.427868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a964273-3a9d-4ae8-b85f-326079aa6e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:41.429603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a964273-3a9d-4ae8-b85f-326079aa6e14 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:41.449696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 606/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:41.454433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:41.520543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:41.576570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e76c8-4b8d-46d1-b40e-d127c4785c84 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:41.620343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450fa06-2e2e-43d8-8b31-68ce0e9a1d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:41.620343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450fa06-2e2e-43d8-8b31-68ce0e9a1d99 None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:41.620343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450fa06-2e2e-43d8-8b31-68ce0e9a1d99 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:41.620789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450fa06-2e2e-43d8-8b31-68ce0e9a1d99 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:41.621249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450fa06-2e2e-43d8-8b31-68ce0e9a1d99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:41.622705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450fa06-2e2e-43d8-8b31-68ce0e9a1d99 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:41.651242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 599/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Sat Sep 3 03:39:41 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:39:43.940880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0bd36-0801-4a7b-9aaf-b3d5b492ba3f None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:43.941497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0bd36-0801-4a7b-9aaf-b3d5b492ba3f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:43.941497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0bd36-0801-4a7b-9aaf-b3d5b492ba3f None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:43.942812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 607/1206] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:39:43.948280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcb44-67d7-460c-a767-c0c1e6d3bcb9 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:43.948737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcb44-67d7-460c-a767-c0c1e6d3bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:43.948843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bcb44-67d7-460c-a767-c0c1e6d3bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:43.968406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c42bcb44-67d7-460c-a767-c0c1e6d3bcb9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:39:43.969666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c42bcb44-67d7-460c-a767-c0c1e6d3bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:39:44.041105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 600/1207] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:39:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:39:44.326380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0bd36-0801-4a7b-9aaf-b3d5b492ba3f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:44.440130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0bd36-0801-4a7b-9aaf-b3d5b492ba3f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:44.482113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:44.482749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:44.483042 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:44.483287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:44.494370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:39:44.499148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:44.500157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:44.501024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 608/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:44.507196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bcb44-67d7-460c-a767-c0c1e6d3bcb9 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:44.549938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:44.619044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bcb44-67d7-460c-a767-c0c1e6d3bcb9 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:44.658574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:44.659299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:44.659565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:44.659810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:44.660464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:44.660766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:44.662180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:44.670368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 601/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:44.676409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:44.729673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:44.785311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f512-ebb4-4bb5-b4f2-3e76c692081c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:44.820859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:44.821517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:44.821794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:44.822097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:44.832486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:44.833970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:44.849401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:44.850640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:44.851758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:44.851758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:44.851758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:44.851758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 609/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:39:44.858631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:44.970212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:44.977378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb29a-2214-415e-95a3-e0b777a49390 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:45.018735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:45.019368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:45.019654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:45.019927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:45.020726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:45.021063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:45.022597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:45.036858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 602/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:39:45.042781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:45.157210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15154c5f-1f35-426c-bc63-5118701003c3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:45.160414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:45.199239 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:45.199875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:45.200972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:45.200972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:45.208983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:45.210549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:39:45.224096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:45.225139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:45.226511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 610/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:45.231591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:45.341730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ee4e6-e00a-4b14-b3d7-1a97492f9519 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:45.383192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:45.383832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:45.384124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:45.384402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:45.385174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:45.385476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:45.387019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:45.411126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 603/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Sep 3 03:39:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:45.412445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:45.531765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d1299-97a4-413f-96e4-102bc912f020 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:45.571927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:45.572579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:45.572823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:45.573213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:45.606660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:45.653301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:45.654761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:45.769000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 611/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:39:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:39:45.775850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:45.798313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:45.926972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ebaa6-f523-4289-9e52-156c50b61dd6 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:45.972596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:45.974070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:45.974541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:45.974999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:45.988656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:45.990662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:46.009721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:46.010822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:46.012174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:46.012174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:46.012174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:46.014008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 604/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:46.020598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:46.089157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:46.136875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3456fe7-0ca3-425b-b23c-3f74bb9a3134 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:46.181486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:46.182103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:46.182408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:46.182686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:46.183337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:46.183835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:46.185366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:46.203644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 612/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:46.204624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:46.281885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:46.319309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959f1f-5ceb-4617-931c-0d0b01780c0f None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:46.363490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:46.364026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:46.364307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:46.364583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:46.371935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:46.373416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:39:46.389660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:46.390645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:39:46.391524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:46.396805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 605/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:46.398235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:46.518952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d1f09-5091-4851-a7c4-2873d492e06f None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:46.552608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:46.568448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9819a-3404-45a4-be49-7c2836aff900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:46.569122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9819a-3404-45a4-be49-7c2836aff900 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:46.569399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9819a-3404-45a4-be49-7c2836aff900 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:46.569669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9819a-3404-45a4-be49-7c2836aff900 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:46.570367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9819a-3404-45a4-be49-7c2836aff900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:46.570668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9819a-3404-45a4-be49-7c2836aff900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:46.572118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9819a-3404-45a4-be49-7c2836aff900 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:46.593009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 613/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:46.596047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:46.743942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd9927-d5d9-404a-b388-1516393af25c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:46.797797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:46.807801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb716a7-683e-4870-9bc9-f58bf747b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:46.808435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb716a7-683e-4870-9bc9-f58bf747b8ed None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:46.808717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb716a7-683e-4870-9bc9-f58bf747b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:46.809023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb716a7-683e-4870-9bc9-f58bf747b8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:46.810802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb716a7-683e-4870-9bc9-f58bf747b8ed None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f28767963d594fef86d3565ea7370c01) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:46.811115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb716a7-683e-4870-9bc9-f58bf747b8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:46.812548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb716a7-683e-4870-9bc9-f58bf747b8ed None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:46.828033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 606/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:39:46 2022] GET /identity/v3/role_assignments?user.id=f28767963d594fef86d3565ea7370c01&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:48.937543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab210-e863-417c-bed2-8fa77298190c None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:48.938298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab210-e863-417c-bed2-8fa77298190c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:48.938298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab210-e863-417c-bed2-8fa77298190c None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:48.939493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 614/1220] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:39:48.945573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafe744-b1de-4413-8512-50d1000ecddc None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:48.946062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafe744-b1de-4413-8512-50d1000ecddc None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:48.946160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafe744-b1de-4413-8512-50d1000ecddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:48.964791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5eafe744-b1de-4413-8512-50d1000ecddc None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:39:48.966597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5eafe744-b1de-4413-8512-50d1000ecddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:39:49.042166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 607/1221] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:39:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:39:49.308459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ab210-e863-417c-bed2-8fa77298190c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:49.422972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ab210-e863-417c-bed2-8fa77298190c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:49.457052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:49.457688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:49.457964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:49.458236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:49.468306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:39:49.473292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:49.474401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:49.475450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 615/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:39:49.482674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafe744-b1de-4413-8512-50d1000ecddc None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:49.585948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafe744-b1de-4413-8512-50d1000ecddc None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:49.611292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:49.625233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:49.625927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:49.626258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:49.626553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:49.627255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:49.627617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:49.629059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:49.638565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 608/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:49.644836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:49.702716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:49.765362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f889-95f0-4c9a-b8d0-5bc0d1eadc8e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:49.801536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:49.802175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:49.802554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:49.802839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:49.813927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:49.815703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:49.833020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:49.834152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:49.835248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:49.835248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:49.835248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:49.835248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 616/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:39:49.840263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:49.952971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282a566-5cd2-4f9d-93b8-0234fa4ce4e0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:49.993574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:49.994410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:49.995518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:49.995518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:49.995927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:49.996426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:49.998002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:50.013271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 609/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:39:50.020279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:50.129304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:50.138436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0330f-7d2e-4cdb-af8e-dd7dfda9db09 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:50.181759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:50.182728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:50.183131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:50.183570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:50.193951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:50.195964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:39:50.212247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:50.213467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:50.214522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 617/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:50.220958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:50.285240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:50.349053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d452863-07d3-4eb0-9b00-e650f32c1b77 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:50.391081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:50.391658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:50.391935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:50.392315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:50.392987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:50.393333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:50.394711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:50.413277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 610/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Sep 3 03:39:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:50.419223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:50.539101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7feed8-7652-4237-8832-f89a6389b62d None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:50.572518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:50.573186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:50.573467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:50.573738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:50.584850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:50.586363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:50.601152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:50.602329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:50.603254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:50.603254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:50.603254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:50.603254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 618/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:50.608604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:50.724527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086a5d-840a-4557-aeb7-43c4f59f694c None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:50.729304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:50.761939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:50.762551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:50.762831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:50.763101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:50.763759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:50.764061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:50.765476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:50.777170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 611/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:50.783192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:50.792764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:50.889680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c827-31f5-4421-8e3e-bcafd115fe48 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:50.922761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:50.923587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:50.924143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:50.924506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:50.932733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:50.934426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:39:50.946706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:50.948195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:50.949138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 619/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:50.954084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:51.067621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568ff1e-32e1-4644-8e05-04a5ba76df9b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:51.102189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211375d-558c-40fd-a106-d3b501ece15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:51.102801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211375d-558c-40fd-a106-d3b501ece15b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:51.103083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211375d-558c-40fd-a106-d3b501ece15b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:51.103357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211375d-558c-40fd-a106-d3b501ece15b None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:51.104045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211375d-558c-40fd-a106-d3b501ece15b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:51.104347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211375d-558c-40fd-a106-d3b501ece15b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:51.105872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211375d-558c-40fd-a106-d3b501ece15b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:51.118150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 612/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:51.124537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:51.197151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:51.237330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f6a0-62fc-48b5-b9df-552cb14364e3 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:51.275900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efddd1e-d785-4c5a-90c6-84682c89fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:51.276707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddd1e-d785-4c5a-90c6-84682c89fcb6 None admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:51.277072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddd1e-d785-4c5a-90c6-84682c89fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:51.277362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efddd1e-d785-4c5a-90c6-84682c89fcb6 None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f28767963d594fef86d3565ea7370c01/roles/1b9d5a0d48404d25866dbae57a2f8ef1` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:51.293319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efddd1e-d785-4c5a-90c6-84682c89fcb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=f28767963d594fef86d3565ea7370c01, role_id=1b9d5a0d48404d25866dbae57a2f8ef1)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:51.294958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efddd1e-d785-4c5a-90c6-84682c89fcb6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:51.311247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 620/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:39:51 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f28767963d594fef86d3565ea7370c01/roles/1b9d5a0d48404d25866dbae57a2f8ef1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:39:53.200325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dfde-9ca5-42ce-86b8-489943782838 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:53.200858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dfde-9ca5-42ce-86b8-489943782838 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:53.200858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dfde-9ca5-42ce-86b8-489943782838 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:53.202281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 613/1233] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:39:53.208176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40cb2-fe67-4b44-bbd1-9422566da745 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:53.208633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40cb2-fe67-4b44-bbd1-9422566da745 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:53.208709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40cb2-fe67-4b44-bbd1-9422566da745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:53.228655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-84a40cb2-fe67-4b44-bbd1-9422566da745 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:39:53.229888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-84a40cb2-fe67-4b44-bbd1-9422566da745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:39:53.301752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 621/1234] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:39:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:39:53.568979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dfde-9ca5-42ce-86b8-489943782838 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:53.599248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:53.687455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dfde-9ca5-42ce-86b8-489943782838 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:53.722351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:53.722921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:53.723282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:53.723536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:53.733954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:39:53.739392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:53.740363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:53.741684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 614/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Sat Sep 3 03:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:53.746735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40cb2-fe67-4b44-bbd1-9422566da745 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:53.796596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:53.854981 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40cb2-fe67-4b44-bbd1-9422566da745 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:53.892251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:53.893137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:53.893421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:53.893709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:53.894364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] RBAC: Adding query filter params (name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:53.894667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:53.896050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:53.905194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 622/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Sat Sep 3 03:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:53.912696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:54.015946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:54.035431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04532003-0bcf-4ec1-8e21-1295ad2546fc None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:54.070827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:54.071631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:54.071938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:54.072212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:54.083788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:54.085337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:54.101337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:54.102515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:54.103398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:54.103398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:54.103398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:54.103398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 615/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:39:54.108557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:54.218493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e546c8-1c09-40e9-9b89-281c905db78c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:54.228994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:54.256890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:54.257616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:54.258002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:54.258263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:54.258983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:54.259326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:54.260800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:54.273702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 623/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:54.281990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:54.408136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d740-7c48-4a73-bd9c-7d2bf9172976 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:54.446178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:54.446829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:54.447109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:54.447377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:54.450244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:54.455325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:54.457461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:39:54.468994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:54.470211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:54.471923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 616/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:54.476248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:54.584418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a69da-b9a2-4573-9900-06786ce7fdd7 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:54.621181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:54.622090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:54.622677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:54.623039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:54.623770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:54.624287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:54.626069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:54.652572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 624/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Sep 3 03:39:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:39:54.659164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:54.782933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560945f-b99f-4223-b053-42a8bc81fb33 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:54.820007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:54.821007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:54.821458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:54.821749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:54.893583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:54.902002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:54.903724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:55.024233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 617/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:39:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 03:39:55.030660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:55.058932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:55.142969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a3782-66da-4bad-a609-495f3ca38ba6 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:55.184287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:55.184939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:55.185233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:55.185501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:55.197271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:55.199020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:55.214546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:55.215737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:55.222670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:55.222670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:55.222670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:55.222670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 625/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:55.223251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:55.327461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:55.334346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59231464-50a2-4989-9345-8eb4d0071c6b None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:55.375580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:55.376196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:55.376505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:55.376779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:55.377600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:55.377937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:55.379260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:55.391203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 618/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:55.397776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:55.482078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:55.506122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c922ed-dbdf-4e6c-8713-78f767a77abd None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:55.544814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:55.545496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:55.545814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:55.546085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:55.553454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:55.555057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:39:55.567762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:55.569050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:55.570065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 626/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:55.575169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:55.684715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bb8f3-ab3f-4f5e-9cd2-13e34cfae075 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:55.722657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d922cbd-7d94-42b7-9557-91c39085e975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:55.723356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922cbd-7d94-42b7-9557-91c39085e975 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:55.723804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922cbd-7d94-42b7-9557-91c39085e975 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:55.724158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d922cbd-7d94-42b7-9557-91c39085e975 None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:55.725525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922cbd-7d94-42b7-9557-91c39085e975 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:55.725945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922cbd-7d94-42b7-9557-91c39085e975 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:55.728152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d922cbd-7d94-42b7-9557-91c39085e975 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:55.745134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 619/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:39:55.752113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:55.860563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7468e8a-f29e-4fd4-be1c-e2d492601c35 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:55.895118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5056be-9fa0-4bf7-8bd5-92c72201e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:55.895727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5056be-9fa0-4bf7-8bd5-92c72201e48c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:55.896007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5056be-9fa0-4bf7-8bd5-92c72201e48c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:55.896280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5056be-9fa0-4bf7-8bd5-92c72201e48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:55.897109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5056be-9fa0-4bf7-8bd5-92c72201e48c None admin] RBAC: Adding query filter params (role.id=1b9d5a0d48404d25866dbae57a2f8ef1, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f28767963d594fef86d3565ea7370c01) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:55.897524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5056be-9fa0-4bf7-8bd5-92c72201e48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:55.899095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5056be-9fa0-4bf7-8bd5-92c72201e48c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:55.906006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 627/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:39:55 2022] GET /identity/v3/role_assignments?user.id=f28767963d594fef86d3565ea7370c01&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=1b9d5a0d48404d25866dbae57a2f8ef1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:57.898659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f45fb-17c1-449d-a7e1-c16c8e514d0c None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:57.899229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f45fb-17c1-449d-a7e1-c16c8e514d0c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:57.899229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f45fb-17c1-449d-a7e1-c16c8e514d0c None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:57.900546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 620/1247] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:39:57.905903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c78446-4d4b-4a21-9a8b-c5cc29ab5685 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:57.906353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c78446-4d4b-4a21-9a8b-c5cc29ab5685 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:57.906454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c78446-4d4b-4a21-9a8b-c5cc29ab5685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:57.913230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:57.927587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-98c78446-4d4b-4a21-9a8b-c5cc29ab5685 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:39:57.928800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-98c78446-4d4b-4a21-9a8b-c5cc29ab5685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:39:58.002620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 628/1248] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:39:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 03:39:58.278580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f45fb-17c1-449d-a7e1-c16c8e514d0c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:58.299922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:58.399764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f45fb-17c1-449d-a7e1-c16c8e514d0c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:58.441569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:58.442165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:58.442575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:58.442853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:58.455173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:39:58.460942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:58.461967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:39:58.462901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:58.467979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 621/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:58.469170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c78446-4d4b-4a21-9a8b-c5cc29ab5685 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:58.585269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c78446-4d4b-4a21-9a8b-c5cc29ab5685 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:58.624831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:58.630858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:58.631553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:58.631899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:58.632257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:58.633043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:58.633290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:58.634933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:58.644286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 629/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:58.650855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:58.734726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:58.760038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a560-e283-4d9b-8f0d-aca57df245ab None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:58.800273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:58.800958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:58.801279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:58.801585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:58.811746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:58.813255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:58.828231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:58.834223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:58.835217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:58.835217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:58.835217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:58.835217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 622/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:58.835442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:58.949558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9acae-8fcf-4b72-a113-692a4ba353cc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:58.987035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:58.987547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:58.987829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:58.988099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:58.988745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:58.989120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:58.990471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:59.002907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 630/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:59.008903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:59.121666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62a14-90c3-4ddf-97c5-9e8d60ccdf84 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:59.148675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:59.157479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:59.158140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:59.158433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:59.158689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:59.166710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:59.168192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:39:59.179688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:59.180883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:39:59.182267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 623/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:39:59.186708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:59.245993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:59.298315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c9a5-b622-4a7f-807a-de0b7e998103 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:59.338779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:59.339357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:59.339681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:59.339953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:59.340683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:39:59.341027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:59.342462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:59.360725 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 631/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Sep 3 03:39:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:39:59.366432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:59.485465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b71fb-99bf-4708-8272-70a64a98ebc0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:59.522763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:59.523384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:59.523673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:59.524021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:59.586242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:59.600725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:59.602601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:59.744431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 624/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:39:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 03:39:59.750170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:39:59.860833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627d476-1c55-499e-8723-481f41712a3b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:39:59.875410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:39:59.899979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:39:59.900779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:39:59.901106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:39:59.901426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:39:59.912930 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:39:59.914833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:39:59.930478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:39:59.931658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:39:59.932580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:39:59.932580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:39:59.932580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:39:59.932580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 632/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:39:59.937608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:00.040061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:00.054120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deba670-ce7e-4a55-b138-03f26507f7b5 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:00.090529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:00.091151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:00.091434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:00.091706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:00.092351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:00.092651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:00.094082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:00.105926 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 625/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:00.112856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:00.228039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12843-d2e3-404b-a961-495150e2b7c4 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:00.265783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:00.266436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:00.266711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:00.267379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:00.277734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:00.279211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:40:00.290560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:00.291628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:00.292535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 633/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:00.297829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:00.407838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dec02d-60ae-4bff-878d-cb59baa768dc None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:00.448874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f6ca8-ebcb-450a-9f72-7008da744e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:00.449513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f6ca8-ebcb-450a-9f72-7008da744e9e None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:00.449821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f6ca8-ebcb-450a-9f72-7008da744e9e None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:00.450052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f6ca8-ebcb-450a-9f72-7008da744e9e None admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:00.450751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f6ca8-ebcb-450a-9f72-7008da744e9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:00.451069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f6ca8-ebcb-450a-9f72-7008da744e9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:00.452524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f6ca8-ebcb-450a-9f72-7008da744e9e None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:00.465435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 626/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:00.472087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:00.498200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:00.580281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d3f0c-8a61-45bb-92a4-d6e24a337e10 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:00.615993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212dad9-4855-4b66-b3ed-8dbf26f1608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:00.616802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212dad9-4855-4b66-b3ed-8dbf26f1608e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:00.617112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212dad9-4855-4b66-b3ed-8dbf26f1608e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:00.617384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212dad9-4855-4b66-b3ed-8dbf26f1608e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:00.618123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212dad9-4855-4b66-b3ed-8dbf26f1608e None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f28767963d594fef86d3565ea7370c01) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:00.618431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212dad9-4855-4b66-b3ed-8dbf26f1608e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:00.619871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212dad9-4855-4b66-b3ed-8dbf26f1608e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:00.626684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 634/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:40:00 2022] GET /identity/v3/role_assignments?user.id=f28767963d594fef86d3565ea7370c01&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:40:02.596011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc690866-4284-43c0-99eb-9b1327b5bcfe None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:02.596839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc690866-4284-43c0-99eb-9b1327b5bcfe None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:02.596839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc690866-4284-43c0-99eb-9b1327b5bcfe None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:02.598961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 627/1261] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:40:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:40:02.607580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b54d-6ecb-4d4c-a6fb-4a8ea725599d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:02.608017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b54d-6ecb-4d4c-a6fb-4a8ea725599d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:02.608184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4b54d-6ecb-4d4c-a6fb-4a8ea725599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:02.629367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8ab4b54d-6ecb-4d4c-a6fb-4a8ea725599d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:40:02.630582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8ab4b54d-6ecb-4d4c-a6fb-4a8ea725599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:40:02.707157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 635/1262] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:40:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:40:02.980080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc690866-4284-43c0-99eb-9b1327b5bcfe None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:02.992882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:03.088005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc690866-4284-43c0-99eb-9b1327b5bcfe None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:03.127244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:03.127864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:03.128145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:03.128420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:03.140152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:40:03.145046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:03.146108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:40:03.147141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 628/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:03.152460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4b54d-6ecb-4d4c-a6fb-4a8ea725599d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:03.176145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:03.262729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4b54d-6ecb-4d4c-a6fb-4a8ea725599d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:03.300404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:03.301034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:03.301314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:03.301584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:03.302246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:03.302550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:03.303925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:03.312673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 636/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:03.318875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:03.390798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:03.426191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff65d8-03b5-467b-8270-2c34bf56c456 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:03.468740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:03.469390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:03.469666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:03.470022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:03.480486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:03.481954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:40:03.497855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:03.498903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:40:03.499914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:40:03.499914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:03.499914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:40:03.499914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 629/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:03.506964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:03.595885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:03.617660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca6ae-af5c-4e47-a6ea-3fa417b9351e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:03.654807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:03.655403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:03.655677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:03.655938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:03.656577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:03.656880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:03.658392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:03.670727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 637/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:03.676695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:03.784993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4180c6-2059-4921-8c64-9de8dc3ea8ff None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:03.816056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:03.832647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:03.833299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:03.833581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:03.833847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:03.841413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:03.842867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:40:03.854099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:03.855158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:40:03.856122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 630/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:40:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:03.862054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:03.966762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57d27-c276-40ac-86ee-7aff309cc6fc None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:04.002174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:04.002766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:04.003025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:04.003404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:04.004148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:04.004508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:04.014496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:04.028045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:04.041094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 638/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Sep 3 03:40:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:04.048812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:04.169491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062e3a-3806-4503-a724-3df069e050a9 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:04.207036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:04.207653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:04.207932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:04.208195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:04.219383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:04.220992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:40:04.235235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:04.236361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:40:04.237349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:40:04.237349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:04.237349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:40:04.237349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 631/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 03:40:04.242854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:04.351562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7af0e-145c-42fb-9cf5-cedb828c0812 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:04.399444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:04.400407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:04.400870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:04.401370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:04.402421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:04.402924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:04.405193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:04.418451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 639/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:40:04.424888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:04.464969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:04.536271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910834dd-8d74-436b-a9e2-ea672355df63 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:04.571475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:04.572090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:04.572375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:04.572645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:04.579826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:04.581307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:40:04.592689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:04.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:40:04.594512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 632/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:04.599772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:04.666650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:04.709832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e77d0-3a0d-4005-9e87-a146c960449e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:04.745643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee549e94-825c-487d-9216-96a60bbc5f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:04.746246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee549e94-825c-487d-9216-96a60bbc5f9d None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:04.746528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee549e94-825c-487d-9216-96a60bbc5f9d None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:04.746802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee549e94-825c-487d-9216-96a60bbc5f9d None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:04.747538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee549e94-825c-487d-9216-96a60bbc5f9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:04.747848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee549e94-825c-487d-9216-96a60bbc5f9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:04.749330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee549e94-825c-487d-9216-96a60bbc5f9d None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:04.761319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 640/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:04.769823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:04.879325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:04.890380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213cd1b-43b5-409e-b38d-353ffe670011 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:04.925101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ebec-b185-4c6c-8278-4703e328265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:04.925743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ebec-b185-4c6c-8278-4703e328265d None admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:04.926021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ebec-b185-4c6c-8278-4703e328265d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:04.926288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ebec-b185-4c6c-8278-4703e328265d None admin] PATH_INFO: `/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f28767963d594fef86d3565ea7370c01/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:04.928414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521ebec-b185-4c6c-8278-4703e328265d None admin] RBAC: Authorizing `identity:create_grant(project_id=3bc30de559d443f4a50b956b2df8a95b, user_id=f28767963d594fef86d3565ea7370c01, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:04.929861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521ebec-b185-4c6c-8278-4703e328265d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:04.951039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 633/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Sat Sep 3 03:40:04 2022] PUT /identity/v3/projects/3bc30de559d443f4a50b956b2df8a95b/users/f28767963d594fef86d3565ea7370c01/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:40:06.816181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8b97-1c88-4608-aecc-8a5a0e302021 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:06.817250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8b97-1c88-4608-aecc-8a5a0e302021 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:06.817250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8b97-1c88-4608-aecc-8a5a0e302021 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:06.819274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 641/1274] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:40:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:40:06.827883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db61848-f3d6-4432-b39e-e437cb8e4e9d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:06.828319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db61848-f3d6-4432-b39e-e437cb8e4e9d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:06.828461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db61848-f3d6-4432-b39e-e437cb8e4e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:06.848542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9db61848-f3d6-4432-b39e-e437cb8e4e9d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:40:06.849789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9db61848-f3d6-4432-b39e-e437cb8e4e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:40:06.923588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 634/1275] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:40:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:40:07.191967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8b97-1c88-4608-aecc-8a5a0e302021 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:07.309920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8b97-1c88-4608-aecc-8a5a0e302021 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:07.329270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:07.347219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:07.347839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:07.348118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:07.348391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:07.358598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 03:40:07.364248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:07.365372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:07.366462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 642/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Sat Sep 3 03:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:07.374069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db61848-f3d6-4432-b39e-e437cb8e4e9d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:07.460976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:07.482639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db61848-f3d6-4432-b39e-e437cb8e4e9d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:07.520302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:07.520895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:07.521206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:07.521480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:07.522122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:07.522423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:07.523818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:07.532246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 635/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Sat Sep 3 03:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:07.538222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:07.650311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5385425-6242-4f46-b931-8f58633da959 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:07.690397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:07.691193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:07.691562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:07.692062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:07.703728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:07.705490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:40:07.720117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:07.721128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:40:07.722096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:40:07.722096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:07.722096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:07.722096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 643/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:07.730652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:07.839751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3702a-6f6c-47b7-b4b7-9f0a352baf32 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:07.875165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:07.875759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:07.876127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:07.876419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:07.877122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:07.877428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:07.878786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:07.891735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 636/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:07.898649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:07.942318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:08.015067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19db0e-7ce4-49cb-974c-3293b175c112 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:08.052774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:08.053431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:08.053703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:08.053983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:08.062443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:08.064087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 03:40:08.075154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:08.076223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:08.077226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 644/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:40:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:08.082623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:08.086909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:08.193612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d32c8-194d-4b9a-8797-5f1da6ba20b4 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:08.230678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:08.231282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:08.231558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:08.231828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:08.232548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:08.232856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:08.234627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:08.256242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 637/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Sat Sep 3 03:40:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:08.264825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:08.363514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:08.374067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5b9aa-318f-4207-96d0-49e2cec2e791 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:08.432715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:08.433350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:08.433621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:08.433892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:08.509872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:08.511348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:08.614316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:08.630137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 645/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Sat Sep 3 03:40:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 03:40:08.636703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:08.701089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:08.746263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04150-f464-4c98-b52d-42a93a6e2587 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:08.784968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:08.785610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:08.785889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:08.786162 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:08.796688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:08.798221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 03:40:08.814190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:08.815264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 03:40:08.816373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 03:40:08.816373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 03:40:08.816373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:40:08.816373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 638/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:08.821901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:08.934463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890ace-372d-4143-a891-8f8ddf6d5820 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:08.969711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:08.970307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:08.970581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:08.970850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:08.971486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:08.971787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:08.973194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:08.984699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 646/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Sat Sep 3 03:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:08.990586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:09.103693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb681b-6cf8-4fb1-96a9-8a41de2d90e0 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:09.117995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:09.140233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:09.140858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:09.141173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:09.141442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:09.148436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:09.149929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 03:40:09.161223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:09.162157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: ERROR keystone.server.flask.application Sep 03 03:40:09.163063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 639/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Sat Sep 3 03:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:09.168281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:09.222123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:09.272268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959239b4-a9a3-410c-ad62-06cde0c20364 None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:09.309425 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c4ef-1ee9-4876-98a4-8c8beb244902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:09.310015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c4ef-1ee9-4876-98a4-8c8beb244902 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:09.310291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c4ef-1ee9-4876-98a4-8c8beb244902 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:09.310558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c4ef-1ee9-4876-98a4-8c8beb244902 None admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:09.311237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c4ef-1ee9-4876-98a4-8c8beb244902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:09.311542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c4ef-1ee9-4876-98a4-8c8beb244902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:09.312968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c4ef-1ee9-4876-98a4-8c8beb244902 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:09.324812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 647/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Sat Sep 3 03:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:09.331676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:09.454564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ae27a-68cf-4ba0-9a91-48a27b812377 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:09.490313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696e352-c782-41a8-8fd2-c5b3db438d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:09.490817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e352-c782-41a8-8fd2-c5b3db438d4d None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:09.491120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e352-c782-41a8-8fd2-c5b3db438d4d None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:09.491394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696e352-c782-41a8-8fd2-c5b3db438d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:09.492108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696e352-c782-41a8-8fd2-c5b3db438d4d None admin] RBAC: Adding query filter params (role.id=eccf9f878fd447279c05a7fd1ddfcb47, scope.project.id=3bc30de559d443f4a50b956b2df8a95b, user.id=f28767963d594fef86d3565ea7370c01) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:09.492414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696e352-c782-41a8-8fd2-c5b3db438d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:09.493865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696e352-c782-41a8-8fd2-c5b3db438d4d None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:09.499726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 640/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Sat Sep 3 03:40:09 2022] GET /identity/v3/role_assignments?user.id=f28767963d594fef86d3565ea7370c01&scope.project.id=3bc30de559d443f4a50b956b2df8a95b&role.id=eccf9f878fd447279c05a7fd1ddfcb47 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:11.409474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d2c4-736a-48f1-8acb-66bd1035ca2e None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:11.410369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d2c4-736a-48f1-8acb-66bd1035ca2e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:11.410369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d2c4-736a-48f1-8acb-66bd1035ca2e None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:11.412701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 648/1288] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:40:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:40:11.418807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe35c35-2883-4f7d-872b-06ba3938808d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:11.419270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe35c35-2883-4f7d-872b-06ba3938808d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:11.419364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe35c35-2883-4f7d-872b-06ba3938808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:11.439417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-abe35c35-2883-4f7d-872b-06ba3938808d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:40:11.440592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-abe35c35-2883-4f7d-872b-06ba3938808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:40:11.481774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:11.523049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 641/1289] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:40:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:40:11.803344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d2c4-736a-48f1-8acb-66bd1035ca2e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:11.915187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d2c4-736a-48f1-8acb-66bd1035ca2e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:11.925916 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:11.951207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:11.951842 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:11.952118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:11.952386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] PATH_INFO: `/v3/services/placement` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:11.952961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:11.954424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:11.963526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:11.964712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:11.965798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:11.969098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 649/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:40:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:11.971132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe35c35-2883-4f7d-872b-06ba3938808d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:12.089619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe35c35-2883-4f7d-872b-06ba3938808d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:12.143821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603b8dd-1c12-4425-a889-2bfe4ffbd6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:12.144422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b8dd-1c12-4425-a889-2bfe4ffbd6b7 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:12.144697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b8dd-1c12-4425-a889-2bfe4ffbd6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:12.144986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b8dd-1c12-4425-a889-2bfe4ffbd6b7 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:12.145634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b8dd-1c12-4425-a889-2bfe4ffbd6b7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:12.145938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b8dd-1c12-4425-a889-2bfe4ffbd6b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:12.147303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b8dd-1c12-4425-a889-2bfe4ffbd6b7 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:12.152186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 642/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Sat Sep 3 03:40:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:12.158272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:12.260853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294034d-9a63-405b-bdb5-eebcc1dfcf9c None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:12.295000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e19c1-ccfc-4b01-916b-4d9f10c5e3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:12.295587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e19c1-ccfc-4b01-916b-4d9f10c5e3e1 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:12.295863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e19c1-ccfc-4b01-916b-4d9f10c5e3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:12.296131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e19c1-ccfc-4b01-916b-4d9f10c5e3e1 None admin] PATH_INFO: `/v3/services` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:12.296746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e19c1-ccfc-4b01-916b-4d9f10c5e3e1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:12.297076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e19c1-ccfc-4b01-916b-4d9f10c5e3e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:12.298475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e19c1-ccfc-4b01-916b-4d9f10c5e3e1 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:12.302867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 650/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Sat Sep 3 03:40:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:14.192066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c7f74-28fd-4243-bf12-d331588923bf None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:14.192573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c7f74-28fd-4243-bf12-d331588923bf None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:14.192573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c7f74-28fd-4243-bf12-d331588923bf None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:14.193983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 643/1293] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:40:14.199298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1b2f5-17be-41ef-9981-7a67982da1a0 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:14.199762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1b2f5-17be-41ef-9981-7a67982da1a0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:14.199853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1b2f5-17be-41ef-9981-7a67982da1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:14.218872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-32b1b2f5-17be-41ef-9981-7a67982da1a0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:40:14.220095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-32b1b2f5-17be-41ef-9981-7a67982da1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:40:14.251810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:14.291429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 651/1294] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:40:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:40:14.558514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c7f74-28fd-4243-bf12-d331588923bf None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:14.598970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:14.693475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c7f74-28fd-4243-bf12-d331588923bf None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:14.731648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40548c1-2b95-48eb-a11f-96068e42dd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:14.732263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40548c1-2b95-48eb-a11f-96068e42dd7b None admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:14.732546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40548c1-2b95-48eb-a11f-96068e42dd7b None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:14.732822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40548c1-2b95-48eb-a11f-96068e42dd7b None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:14.733542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40548c1-2b95-48eb-a11f-96068e42dd7b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:14.735329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40548c1-2b95-48eb-a11f-96068e42dd7b None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:14.751579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 644/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Sat Sep 3 03:40:14 2022] POST /identity/v3/services => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:40:16.644655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b995-8501-4cde-80d8-f0b198f3da95 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:16.645586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b995-8501-4cde-80d8-f0b198f3da95 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:16.645586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5b995-8501-4cde-80d8-f0b198f3da95 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:16.647747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 652/1296] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:40:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:40:16.653893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cd58b-b415-413b-bf63-c7f2afeea186 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:16.654338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cd58b-b415-413b-bf63-c7f2afeea186 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:16.654473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cd58b-b415-413b-bf63-c7f2afeea186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:16.682045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7f9cd58b-b415-413b-bf63-c7f2afeea186 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:40:16.683242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7f9cd58b-b415-413b-bf63-c7f2afeea186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:40:16.769533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 645/1297] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:40:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:40:17.056042 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b995-8501-4cde-80d8-f0b198f3da95 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:17.167658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5b995-8501-4cde-80d8-f0b198f3da95 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:17.211674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:17.212289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:17.212568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:17.212838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] PATH_INFO: `/v3/services/placement` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:17.213455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:17.214830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:17.224289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:17.228990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:17.230047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 653/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:40:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:17.231580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cd58b-b415-413b-bf63-c7f2afeea186 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:17.252925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:17.339447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cd58b-b415-413b-bf63-c7f2afeea186 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:17.374649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:17.375242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:17.375517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:17.375827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:17.376439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:17.376733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:17.378138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:17.383334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 646/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Sat Sep 3 03:40:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:17.390168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:17.425451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:17.498532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc448c-44de-4640-bd59-03f53b32962e None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:17.531392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b1e2a-0dba-46ee-9f66-1a87ab180301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:17.532026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b1e2a-0dba-46ee-9f66-1a87ab180301 None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:17.532307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b1e2a-0dba-46ee-9f66-1a87ab180301 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:17.532565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b1e2a-0dba-46ee-9f66-1a87ab180301 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:17.533308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b1e2a-0dba-46ee-9f66-1a87ab180301 None admin] RBAC: Adding query filter params (interface=public, service_id=2bd306b399454da0b00821ad59d6509f, region_id=RegionOne) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:17.533621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b1e2a-0dba-46ee-9f66-1a87ab180301 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:17.534994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b1e2a-0dba-46ee-9f66-1a87ab180301 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:17.540126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 654/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Sat Sep 3 03:40:17 2022] GET /identity/v3/endpoints?service_id=2bd306b399454da0b00821ad59d6509f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:17.548838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:17.640476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:17.662865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3811d-32d5-45a5-a663-9153923abe71 None admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:17.702545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d91bf-197c-4bec-a7c3-7437c4062511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:17.703163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d91bf-197c-4bec-a7c3-7437c4062511 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:17.703453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d91bf-197c-4bec-a7c3-7437c4062511 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:17.703981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d91bf-197c-4bec-a7c3-7437c4062511 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:17.704597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d91bf-197c-4bec-a7c3-7437c4062511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:17.706004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d91bf-197c-4bec-a7c3-7437c4062511 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:17.712904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 647/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Sat Sep 3 03:40:17 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:40:19.576235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7e9b-f37b-47a8-90c1-7b54ae40b71a None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:19.576760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7e9b-f37b-47a8-90c1-7b54ae40b71a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:19.576760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7e9b-f37b-47a8-90c1-7b54ae40b71a None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:19.578081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 655/1302] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:40:19.583485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18ca5-34de-4c68-930a-cee69fa80a36 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:19.583925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18ca5-34de-4c68-930a-cee69fa80a36 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:19.584025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18ca5-34de-4c68-930a-cee69fa80a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:19.604029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-92d18ca5-34de-4c68-930a-cee69fa80a36 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:40:19.605248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-92d18ca5-34de-4c68-930a-cee69fa80a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:40:19.676504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 648/1303] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:40:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 03:40:19.938577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7e9b-f37b-47a8-90c1-7b54ae40b71a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:20.063710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:20.071697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7e9b-f37b-47a8-90c1-7b54ae40b71a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:20.107672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:20.108290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:20.108568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:20.108845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] PATH_INFO: `/v3/services/placement` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:20.109769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:20.111186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 03:40:20.120287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 03:40:20.121447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application with Lock( Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self._enter() Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application return self.creator() Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application created_value = creator( Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: ERROR keystone.server.flask.application Sep 03 03:40:20.122644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 656/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Sat Sep 3 03:40:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 03:40:20.127580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d18ca5-34de-4c68-930a-cee69fa80a36 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:20.211094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:20.235030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d18ca5-34de-4c68-930a-cee69fa80a36 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:20.271639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6053794-10ae-4126-9b87-674a40ed1f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:20.272246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053794-10ae-4126-9b87-674a40ed1f94 None admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:20.272527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053794-10ae-4126-9b87-674a40ed1f94 None admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:20.272803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053794-10ae-4126-9b87-674a40ed1f94 None admin] PATH_INFO: `/v3/services` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:20.273466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6053794-10ae-4126-9b87-674a40ed1f94 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:40:20.273768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6053794-10ae-4126-9b87-674a40ed1f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:20.275134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6053794-10ae-4126-9b87-674a40ed1f94 None admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:20.280954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 649/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Sat Sep 3 03:40:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:40:20.287079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:40:20.395228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817434-d300-4cdb-a709-53fd5d6e755b None admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:40:20.431003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4be87-ac27-44ee-a16b-f5fd978f0db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:40:20.431605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4be87-ac27-44ee-a16b-f5fd978f0db8 None admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:40:20.431881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4be87-ac27-44ee-a16b-f5fd978f0db8 None admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:40:20.432154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4be87-ac27-44ee-a16b-f5fd978f0db8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:40:20.432820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4be87-ac27-44ee-a16b-f5fd978f0db8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:40:20.434243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4be87-ac27-44ee-a16b-f5fd978f0db8 None admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:40:20.457141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 657/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:40:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:40:30.277550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=30 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:40:30.452441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:24.488484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962712b-7af8-400f-bd37-1be88b7caa84 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:24.489434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962712b-7af8-400f-bd37-1be88b7caa84 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:24.489856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962712b-7af8-400f-bd37-1be88b7caa84 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:24.495167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 650/1307] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:24.496681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92ec8-4619-4044-8ac8-50a46dda0a6b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:24.497632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92ec8-4619-4044-8ac8-50a46dda0a6b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:24.498301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f92ec8-4619-4044-8ac8-50a46dda0a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:24.576651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-46f92ec8-4619-4044-8ac8-50a46dda0a6b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:24.578033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-46f92ec8-4619-4044-8ac8-50a46dda0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:24.709859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 658/1308] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:41:24.989100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91786-2588-4f25-b71d-6600f55caab4 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:24.989572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91786-2588-4f25-b71d-6600f55caab4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:24.990033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91786-2588-4f25-b71d-6600f55caab4 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:24.991629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 651/1309] 10.222.0.13 () {54 vars in 965 bytes} [Sat Sep 3 03:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:24.998383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6c329-9d9a-4b20-a8e4-0a3183e03d52 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:24.998903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6c329-9d9a-4b20-a8e4-0a3183e03d52 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:24.999383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6c329-9d9a-4b20-a8e4-0a3183e03d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:25.073625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2cc6c329-9d9a-4b20-a8e4-0a3183e03d52 None None] MFA Rules not processed for user `c1a7ee9f78da46e4abe27eadb2d17b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:25.074822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2cc6c329-9d9a-4b20-a8e4-0a3183e03d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:25.094885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:25.153536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 659/1310] 10.222.0.13 () {58 vars in 1062 bytes} [Sat Sep 3 03:41:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:25.163399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f91786-2588-4f25-b71d-6600f55caab4 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:25.165217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-97f91786-2588-4f25-b71d-6600f55caab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:25.290600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f91786-2588-4f25-b71d-6600f55caab4 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:25.387831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d68f45-609e-438c-b668-a8b64ec40c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:25.388455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68f45-609e-438c-b668-a8b64ec40c07 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:25.388737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68f45-609e-438c-b668-a8b64ec40c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:25.389106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68f45-609e-438c-b668-a8b64ec40c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:25.391195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-15d68f45-609e-438c-b668-a8b64ec40c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:25.454815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:25.514502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d68f45-609e-438c-b668-a8b64ec40c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:25.516049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d68f45-609e-438c-b668-a8b64ec40c07 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:25.536250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 652/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:27.745323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb647-2aac-41b0-ae87-d783078f9f10 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:27.745861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb647-2aac-41b0-ae87-d783078f9f10 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:27.745861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cb647-2aac-41b0-ae87-d783078f9f10 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:27.747458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 660/1312] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:27.753436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764714b-1205-40ce-8556-7252861ebf65 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:27.753976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764714b-1205-40ce-8556-7252861ebf65 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:27.753976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764714b-1205-40ce-8556-7252861ebf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:27.851305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c764714b-1205-40ce-8556-7252861ebf65 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:27.852546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c764714b-1205-40ce-8556-7252861ebf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:27.963580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 653/1313] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:28.256712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe53b-3948-4561-9cef-058a44200b7b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:28.256996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe53b-3948-4561-9cef-058a44200b7b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:28.257283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbe53b-3948-4561-9cef-058a44200b7b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:28.258633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 661/1314] 10.222.0.13 () {54 vars in 965 bytes} [Sat Sep 3 03:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:28.264278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f8f-5ed2-4bb6-8ecd-bb8bf68cb7a7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:28.264534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f8f-5ed2-4bb6-8ecd-bb8bf68cb7a7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:28.264809 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f8f-5ed2-4bb6-8ecd-bb8bf68cb7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:28.276960 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:28.349757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a0e82f8f-5ed2-4bb6-8ecd-bb8bf68cb7a7 None None] MFA Rules not processed for user `c1a7ee9f78da46e4abe27eadb2d17b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:28.350894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a0e82f8f-5ed2-4bb6-8ecd-bb8bf68cb7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:28.432763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 654/1315] 10.222.0.13 () {58 vars in 1062 bytes} [Sat Sep 3 03:41:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:28.442555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe53b-3948-4561-9cef-058a44200b7b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:28.444218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aefbe53b-3948-4561-9cef-058a44200b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:28.551636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbe53b-3948-4561-9cef-058a44200b7b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:28.630357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:28.632968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa5361-94d3-4dd1-b69b-10b6381c21da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:28.633869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa5361-94d3-4dd1-b69b-10b6381c21da service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:28.634154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa5361-94d3-4dd1-b69b-10b6381c21da service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:28.634431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa5361-94d3-4dd1-b69b-10b6381c21da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:28.636506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fdaa5361-94d3-4dd1-b69b-10b6381c21da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:28.748668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa5361-94d3-4dd1-b69b-10b6381c21da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:28.750166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa5361-94d3-4dd1-b69b-10b6381c21da service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:28.769851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 662/1316] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:31.238984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0053-01c1-44d7-bfe6-85fa20e5513d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:31.239527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0053-01c1-44d7-bfe6-85fa20e5513d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:31.239527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0053-01c1-44d7-bfe6-85fa20e5513d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:31.240893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 655/1317] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:31.247164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4627db-fbfa-4ce6-86cf-388bf5e94fa1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:31.247633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4627db-fbfa-4ce6-86cf-388bf5e94fa1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:31.247820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4627db-fbfa-4ce6-86cf-388bf5e94fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:31.316191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8a4627db-fbfa-4ce6-86cf-388bf5e94fa1 None None] MFA Rules not processed for user `3b4cd934abbd4b7bb59c7d168dacd9af`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:31.317442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8a4627db-fbfa-4ce6-86cf-388bf5e94fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:31.370992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:31.418903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 663/1318] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:31.711432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0053-01c1-44d7-bfe6-85fa20e5513d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:31.713957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7c6a0053-01c1-44d7-bfe6-85fa20e5513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:31.832121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0053-01c1-44d7-bfe6-85fa20e5513d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:31.834941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:31.920426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f635e-ff31-49de-b2da-83acceb2cca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:31.921066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f635e-ff31-49de-b2da-83acceb2cca7 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:31.921347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f635e-ff31-49de-b2da-83acceb2cca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:31.921653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f635e-ff31-49de-b2da-83acceb2cca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:31.923296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1c8f635e-ff31-49de-b2da-83acceb2cca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:32.046700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f635e-ff31-49de-b2da-83acceb2cca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:32.048071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f635e-ff31-49de-b2da-83acceb2cca7 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:32.067850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 656/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:34.538937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341926d-6794-429d-8b9b-98a9c02b65c7 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:34.539500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341926d-6794-429d-8b9b-98a9c02b65c7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:34.539500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341926d-6794-429d-8b9b-98a9c02b65c7 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:34.540838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 664/1320] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:34.546995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b46ec-9330-4fb8-ae41-026241ab639c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:34.547781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b46ec-9330-4fb8-ae41-026241ab639c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:34.547914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b46ec-9330-4fb8-ae41-026241ab639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:34.599191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:34.628608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-626b46ec-9330-4fb8-ae41-026241ab639c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:34.629990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-626b46ec-9330-4fb8-ae41-026241ab639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:34.732825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 657/1321] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:35.031402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341926d-6794-429d-8b9b-98a9c02b65c7 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:35.032944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c341926d-6794-429d-8b9b-98a9c02b65c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:35.148197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341926d-6794-429d-8b9b-98a9c02b65c7 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:35.229728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e62e-ef95-4e03-a83f-1a049a42ce2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:35.230338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e62e-ef95-4e03-a83f-1a049a42ce2e service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:35.230614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e62e-ef95-4e03-a83f-1a049a42ce2e service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:35.230895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e62e-ef95-4e03-a83f-1a049a42ce2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:35.232537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b9b2e62e-ef95-4e03-a83f-1a049a42ce2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:35.241036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:35.360078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e62e-ef95-4e03-a83f-1a049a42ce2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:35.361474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e62e-ef95-4e03-a83f-1a049a42ce2e service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:35.379528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 665/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:37.973980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e15cd-c0d5-4e88-bdf7-953d522ab2de None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:37.974561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e15cd-c0d5-4e88-bdf7-953d522ab2de None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:37.974561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e15cd-c0d5-4e88-bdf7-953d522ab2de None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:37.975865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 658/1323] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:37.981606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304fc6a-1f97-4627-a013-14acffd1406d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:37.982115 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304fc6a-1f97-4627-a013-14acffd1406d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:37.982209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304fc6a-1f97-4627-a013-14acffd1406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:38.051489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d304fc6a-1f97-4627-a013-14acffd1406d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:38.052729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d304fc6a-1f97-4627-a013-14acffd1406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:38.119322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:38.165155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 666/1324] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:38.440076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e15cd-c0d5-4e88-bdf7-953d522ab2de None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:38.441663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0d8e15cd-c0d5-4e88-bdf7-953d522ab2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:38.551486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e15cd-c0d5-4e88-bdf7-953d522ab2de None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:38.566580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:38.638676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82da31-d15b-411d-b125-b8f370ba5268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:38.639380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82da31-d15b-411d-b125-b8f370ba5268 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:38.639656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82da31-d15b-411d-b125-b8f370ba5268 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:38.639925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82da31-d15b-411d-b125-b8f370ba5268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:38.641531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cd82da31-d15b-411d-b125-b8f370ba5268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:38.761188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82da31-d15b-411d-b125-b8f370ba5268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:38.762613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82da31-d15b-411d-b125-b8f370ba5268 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:38.781429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 659/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:40.750683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443da54b-b4de-4d0b-ac87-e394f330f516 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:40.751252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443da54b-b4de-4d0b-ac87-e394f330f516 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:40.751252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443da54b-b4de-4d0b-ac87-e394f330f516 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:40.752505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 667/1326] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:40.758107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b677b-7966-44ff-ba2d-a1adcf221dfc None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:40.758554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b677b-7966-44ff-ba2d-a1adcf221dfc None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:40.758668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b677b-7966-44ff-ba2d-a1adcf221dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:40.809876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:40.829146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9c2b677b-7966-44ff-ba2d-a1adcf221dfc None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:40.830346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9c2b677b-7966-44ff-ba2d-a1adcf221dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:40.933269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 660/1327] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:41.226241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443da54b-b4de-4d0b-ac87-e394f330f516 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:41.227884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-443da54b-b4de-4d0b-ac87-e394f330f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:41.349925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443da54b-b4de-4d0b-ac87-e394f330f516 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:41.431184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1cd04-a3b9-4155-a819-30a83c5ffe98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:41.431713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1cd04-a3b9-4155-a819-30a83c5ffe98 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:41.431988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1cd04-a3b9-4155-a819-30a83c5ffe98 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:41.432262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1cd04-a3b9-4155-a819-30a83c5ffe98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:41.433903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5fe1cd04-a3b9-4155-a819-30a83c5ffe98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:41.452381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:41.544856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1cd04-a3b9-4155-a819-30a83c5ffe98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:41.546379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1cd04-a3b9-4155-a819-30a83c5ffe98 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:41.564780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 668/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:43.524109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea70f6-5973-47bc-b53c-f2027db868fe None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:43.524695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea70f6-5973-47bc-b53c-f2027db868fe None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:43.524695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea70f6-5973-47bc-b53c-f2027db868fe None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:43.526003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 661/1329] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:41:43.531401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83acdd-c31e-41c6-8898-e2a3b9a9a3a0 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:43.531848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83acdd-c31e-41c6-8898-e2a3b9a9a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:43.531947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83acdd-c31e-41c6-8898-e2a3b9a9a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:43.600540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4b83acdd-c31e-41c6-8898-e2a3b9a9a3a0 None None] MFA Rules not processed for user `3b4cd934abbd4b7bb59c7d168dacd9af`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:43.601772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4b83acdd-c31e-41c6-8898-e2a3b9a9a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:43.669398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:43.704820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 669/1330] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:43.986341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea70f6-5973-47bc-b53c-f2027db868fe None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:43.987881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2dea70f6-5973-47bc-b53c-f2027db868fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:44.102081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea70f6-5973-47bc-b53c-f2027db868fe None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:44.125013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:44.189055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a85847-6082-4c11-b1c8-726e65b7cd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:44.189672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85847-6082-4c11-b1c8-726e65b7cd46 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:44.189947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85847-6082-4c11-b1c8-726e65b7cd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:44.190213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a85847-6082-4c11-b1c8-726e65b7cd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:44.191806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-26a85847-6082-4c11-b1c8-726e65b7cd46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:44.306247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a85847-6082-4c11-b1c8-726e65b7cd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:44.307718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a85847-6082-4c11-b1c8-726e65b7cd46 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:44.326324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 662/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:46.434386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaea3e1-7550-4455-ae60-83bd050db900 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:46.434980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaea3e1-7550-4455-ae60-83bd050db900 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:46.435228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaea3e1-7550-4455-ae60-83bd050db900 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:46.436594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 670/1332] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:46.442157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d340-26fd-4a2f-8fbf-fccd1bbba1c7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:46.442547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d340-26fd-4a2f-8fbf-fccd1bbba1c7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:46.442707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d340-26fd-4a2f-8fbf-fccd1bbba1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:46.511723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:46.514789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-dc37d340-26fd-4a2f-8fbf-fccd1bbba1c7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:46.516779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-dc37d340-26fd-4a2f-8fbf-fccd1bbba1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:46.614963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 663/1333] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:46.906219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaea3e1-7550-4455-ae60-83bd050db900 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:46.908524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fbaea3e1-7550-4455-ae60-83bd050db900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:47.023375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaea3e1-7550-4455-ae60-83bd050db900 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:47.114592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75792d5e-03dd-41ca-93e6-2e964c9a0c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:47.115193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75792d5e-03dd-41ca-93e6-2e964c9a0c3a service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:47.115616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75792d5e-03dd-41ca-93e6-2e964c9a0c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:47.115720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75792d5e-03dd-41ca-93e6-2e964c9a0c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:47.117466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-75792d5e-03dd-41ca-93e6-2e964c9a0c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:47.151902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:47.255422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75792d5e-03dd-41ca-93e6-2e964c9a0c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:47.256869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75792d5e-03dd-41ca-93e6-2e964c9a0c3a service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:47.275537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 671/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:49.278729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbe8c-247b-4f77-b93a-c5cf9dd30162 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:49.279540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbe8c-247b-4f77-b93a-c5cf9dd30162 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:49.280051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbe8c-247b-4f77-b93a-c5cf9dd30162 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:49.282296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 664/1335] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:49.287678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64de205-67b8-4926-8436-cf284edb08c4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:49.288141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64de205-67b8-4926-8436-cf284edb08c4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:49.288232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64de205-67b8-4926-8436-cf284edb08c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:49.355893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a64de205-67b8-4926-8436-cf284edb08c4 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:49.357212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a64de205-67b8-4926-8436-cf284edb08c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:49.439558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:49.462694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 672/1336] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:49.760766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddbe8c-247b-4f77-b93a-c5cf9dd30162 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:49.763278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6dddbe8c-247b-4f77-b93a-c5cf9dd30162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:49.890833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddbe8c-247b-4f77-b93a-c5cf9dd30162 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:49.922457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:49.980525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55654054-8e6f-413b-af1a-e9ad5951f7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:49.981177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55654054-8e6f-413b-af1a-e9ad5951f7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:49.981631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55654054-8e6f-413b-af1a-e9ad5951f7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:49.981856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55654054-8e6f-413b-af1a-e9ad5951f7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:49.983786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-55654054-8e6f-413b-af1a-e9ad5951f7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:50.108274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55654054-8e6f-413b-af1a-e9ad5951f7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:50.109752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55654054-8e6f-413b-af1a-e9ad5951f7a4 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:50.128659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 665/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:52.385355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c46a-7034-4899-9ad2-d11d69e93913 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:52.385987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c46a-7034-4899-9ad2-d11d69e93913 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:52.385987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172c46a-7034-4899-9ad2-d11d69e93913 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:52.387145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 673/1338] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:52.393676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b108abe-0ac6-4bf9-be6c-ae31f1fdab9d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:52.394404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b108abe-0ac6-4bf9-be6c-ae31f1fdab9d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:52.394575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b108abe-0ac6-4bf9-be6c-ae31f1fdab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:52.471746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6b108abe-0ac6-4bf9-be6c-ae31f1fdab9d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:52.472957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6b108abe-0ac6-4bf9-be6c-ae31f1fdab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:52.481601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:52.596957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 666/1339] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:52.886066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c46a-7034-4899-9ad2-d11d69e93913 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:52.888327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1172c46a-7034-4899-9ad2-d11d69e93913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:53.000937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172c46a-7034-4899-9ad2-d11d69e93913 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:53.086221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8fc8d-c5f0-4b8f-b30e-6c90851c59a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:53.086825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8fc8d-c5f0-4b8f-b30e-6c90851c59a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:53.087104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8fc8d-c5f0-4b8f-b30e-6c90851c59a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:53.087374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8fc8d-c5f0-4b8f-b30e-6c90851c59a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:53.089001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d9b8fc8d-c5f0-4b8f-b30e-6c90851c59a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:53.126435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:53.205542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8fc8d-c5f0-4b8f-b30e-6c90851c59a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:53.207027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8fc8d-c5f0-4b8f-b30e-6c90851c59a4 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:53.226238 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 674/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:41:57.096951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b72fd-d051-4e72-8607-a0ee494e0a6b None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:57.097507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b72fd-d051-4e72-8607-a0ee494e0a6b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:57.097507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b72fd-d051-4e72-8607-a0ee494e0a6b None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:57.098891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 667/1341] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:41:57.104127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814eb4-b637-44be-83e4-7b6ccad6f724 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:57.104551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814eb4-b637-44be-83e4-7b6ccad6f724 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:57.104663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814eb4-b637-44be-83e4-7b6ccad6f724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:57.180300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-69814eb4-b637-44be-83e4-7b6ccad6f724 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:41:57.181612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-69814eb4-b637-44be-83e4-7b6ccad6f724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:57.271716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:57.284515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 675/1342] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:41:57.563700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b72fd-d051-4e72-8607-a0ee494e0a6b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:41:57.565273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-099b72fd-d051-4e72-8607-a0ee494e0a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:57.688930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b72fd-d051-4e72-8607-a0ee494e0a6b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:41:57.728471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:41:57.765933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ce22f-0258-460f-b5b0-6e2a47664b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:41:57.766539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce22f-0258-460f-b5b0-6e2a47664b4a service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:41:57.766810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce22f-0258-460f-b5b0-6e2a47664b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:41:57.767074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ce22f-0258-460f-b5b0-6e2a47664b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:41:57.768805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b89ce22f-0258-460f-b5b0-6e2a47664b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:41:57.880823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ce22f-0258-460f-b5b0-6e2a47664b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:41:57.882274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ce22f-0258-460f-b5b0-6e2a47664b4a service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:41:57.901678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 668/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:00.502075 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c23b-38aa-4519-9a42-875ba384a10b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:00.502662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c23b-38aa-4519-9a42-875ba384a10b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:00.502662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c23b-38aa-4519-9a42-875ba384a10b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:00.504125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 676/1344] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:00.509289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e562d3b-c9c8-4f62-85eb-2c7ba6619c21 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:00.509738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e562d3b-c9c8-4f62-85eb-2c7ba6619c21 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:00.509831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e562d3b-c9c8-4f62-85eb-2c7ba6619c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:00.579610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9e562d3b-c9c8-4f62-85eb-2c7ba6619c21 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:00.580847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9e562d3b-c9c8-4f62-85eb-2c7ba6619c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:00.600316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:00.680947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 669/1345] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:00.956869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c23b-38aa-4519-9a42-875ba384a10b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:00.958432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-44c2c23b-38aa-4519-9a42-875ba384a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:01.081376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c23b-38aa-4519-9a42-875ba384a10b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:01.171244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd622c28-b83e-47cb-8193-cc1c9d5faf9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:01.171857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622c28-b83e-47cb-8193-cc1c9d5faf9d service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:01.172132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622c28-b83e-47cb-8193-cc1c9d5faf9d service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:01.172400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622c28-b83e-47cb-8193-cc1c9d5faf9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:01.174054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fd622c28-b83e-47cb-8193-cc1c9d5faf9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:01.220442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:01.290428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd622c28-b83e-47cb-8193-cc1c9d5faf9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:01.291925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd622c28-b83e-47cb-8193-cc1c9d5faf9d service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:01.311380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 677/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:05.189106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a290492-9b30-4eed-853e-f8be8ce3cd8d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:05.189665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a290492-9b30-4eed-853e-f8be8ce3cd8d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:05.189665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a290492-9b30-4eed-853e-f8be8ce3cd8d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:05.191186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 670/1347] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:05.196665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb59e-4599-46f0-aedf-346a7277c127 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:05.197187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb59e-4599-46f0-aedf-346a7277c127 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:05.197187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb59e-4599-46f0-aedf-346a7277c127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:05.269571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2edbb59e-4599-46f0-aedf-346a7277c127 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:05.270805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2edbb59e-4599-46f0-aedf-346a7277c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:05.373951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:05.376598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 678/1348] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:05.663680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a290492-9b30-4eed-853e-f8be8ce3cd8d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:05.665305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2a290492-9b30-4eed-853e-f8be8ce3cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:05.773290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a290492-9b30-4eed-853e-f8be8ce3cd8d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:05.820382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:05.847608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80add1-3c0b-460d-a5ec-b7de2f3e9242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:05.848179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80add1-3c0b-460d-a5ec-b7de2f3e9242 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:05.848454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80add1-3c0b-460d-a5ec-b7de2f3e9242 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:05.848719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80add1-3c0b-460d-a5ec-b7de2f3e9242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:05.850336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5c80add1-3c0b-460d-a5ec-b7de2f3e9242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:05.966367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80add1-3c0b-460d-a5ec-b7de2f3e9242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:05.967829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c80add1-3c0b-460d-a5ec-b7de2f3e9242 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:05.988596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 671/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:10.896246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb202-b0b5-4014-bcc7-f8b75f53b6f5 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:10.896246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb202-b0b5-4014-bcc7-f8b75f53b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:10.896764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb202-b0b5-4014-bcc7-f8b75f53b6f5 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:10.898362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 679/1350] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:10.903481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093654fa-acb9-449a-bc3f-a24fa743c904 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:10.903933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093654fa-acb9-449a-bc3f-a24fa743c904 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:10.904014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093654fa-acb9-449a-bc3f-a24fa743c904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:10.997908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-093654fa-acb9-449a-bc3f-a24fa743c904 None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:10.999681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-093654fa-acb9-449a-bc3f-a24fa743c904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:11.030336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:11.154606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 672/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:42:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:15.250726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967b11-6534-4ffe-8064-83699bbc6811 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:15.251607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967b11-6534-4ffe-8064-83699bbc6811 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:15.251874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967b11-6534-4ffe-8064-83699bbc6811 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:15.253697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 680/1352] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:15.260132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c1375-dbb1-4713-bfd0-82035e0b66cc None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:15.260547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c1375-dbb1-4713-bfd0-82035e0b66cc None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:15.260735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c1375-dbb1-4713-bfd0-82035e0b66cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:15.343319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c94c1375-dbb1-4713-bfd0-82035e0b66cc None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:15.344535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c94c1375-dbb1-4713-bfd0-82035e0b66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:15.422723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:15.460471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 673/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:42:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:16.797771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82d0e-dad9-4cad-8664-b422e1161e8d None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:16.798331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82d0e-dad9-4cad-8664-b422e1161e8d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:16.798331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c82d0e-dad9-4cad-8664-b422e1161e8d None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:16.799808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 681/1354] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:16.804863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25380-0dae-460b-a47a-4620dc0180fa None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:16.805320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25380-0dae-460b-a47a-4620dc0180fa None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:16.805462 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb25380-0dae-460b-a47a-4620dc0180fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:16.885976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-cbb25380-0dae-460b-a47a-4620dc0180fa None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:16.887369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cbb25380-0dae-460b-a47a-4620dc0180fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:16.998094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 674/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:42:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:20.286236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fef10-6da9-4bd9-a666-87a1167899b6 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:20.286801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fef10-6da9-4bd9-a666-87a1167899b6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:20.286801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fef10-6da9-4bd9-a666-87a1167899b6 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:20.288118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 682/1356] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:20.293397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078528-192e-4e45-a207-73cf64e6d832 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:20.293849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078528-192e-4e45-a207-73cf64e6d832 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:20.293955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45078528-192e-4e45-a207-73cf64e6d832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:20.332254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:20.373404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-45078528-192e-4e45-a207-73cf64e6d832 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:20.374524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-45078528-192e-4e45-a207-73cf64e6d832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:20.503445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 675/1357] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:42:20.808539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100dbc6-bcc6-4a78-a07c-6ba5366d3a7d None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:20.809088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100dbc6-bcc6-4a78-a07c-6ba5366d3a7d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:20.809512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100dbc6-bcc6-4a78-a07c-6ba5366d3a7d None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:20.811268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 683/1358] 10.222.0.13 () {54 vars in 962 bytes} [Sat Sep 3 03:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:20.818761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af20ea-c792-4dae-8046-0b24b00b00dd None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:20.819563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af20ea-c792-4dae-8046-0b24b00b00dd None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:20.821054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af20ea-c792-4dae-8046-0b24b00b00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:20.900228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-31af20ea-c792-4dae-8046-0b24b00b00dd None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:20.901548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-31af20ea-c792-4dae-8046-0b24b00b00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:20.953579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:21.037103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 676/1359] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Sep 3 03:42:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:21.045983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100dbc6-bcc6-4a78-a07c-6ba5366d3a7d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:21.047505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2100dbc6-bcc6-4a78-a07c-6ba5366d3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:21.205279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100dbc6-bcc6-4a78-a07c-6ba5366d3a7d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:21.286607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:21.329018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba694011-4440-4fd1-97f1-0ded54f040cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:21.329577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba694011-4440-4fd1-97f1-0ded54f040cb service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:21.329856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba694011-4440-4fd1-97f1-0ded54f040cb service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:21.330089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba694011-4440-4fd1-97f1-0ded54f040cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:21.331688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ba694011-4440-4fd1-97f1-0ded54f040cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:21.445782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba694011-4440-4fd1-97f1-0ded54f040cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:21.447545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba694011-4440-4fd1-97f1-0ded54f040cb service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:21.466324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 684/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:42:23.574390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ae923-d050-4fbb-addd-aa535d18702b None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:23.574986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ae923-d050-4fbb-addd-aa535d18702b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:23.574986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ae923-d050-4fbb-addd-aa535d18702b None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:23.576961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 677/1361] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:23.582385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ab01-0c5d-4806-b6d0-67bbf8dd591e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:23.582849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ab01-0c5d-4806-b6d0-67bbf8dd591e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:23.582941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04ab01-0c5d-4806-b6d0-67bbf8dd591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:23.661946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-fb04ab01-0c5d-4806-b6d0-67bbf8dd591e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:23.663135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fb04ab01-0c5d-4806-b6d0-67bbf8dd591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:23.703098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:23.783652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 685/1362] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:24.068655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ae923-d050-4fbb-addd-aa535d18702b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:24.070189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-066ae923-d050-4fbb-addd-aa535d18702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:24.218165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ae923-d050-4fbb-addd-aa535d18702b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:24.227724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:24.339310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa6fb-2d66-4695-905a-42330a7d16d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:24.340017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa6fb-2d66-4695-905a-42330a7d16d7 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:24.340299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa6fb-2d66-4695-905a-42330a7d16d7 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:24.340571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa6fb-2d66-4695-905a-42330a7d16d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:24.342898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7d6fa6fb-2d66-4695-905a-42330a7d16d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:24.445579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa6fb-2d66-4695-905a-42330a7d16d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:24.447190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa6fb-2d66-4695-905a-42330a7d16d7 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:24.467756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 678/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:26.884048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036f9a4-a28e-42c7-8476-b3e2981694ac None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:26.884567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036f9a4-a28e-42c7-8476-b3e2981694ac None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:26.884567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036f9a4-a28e-42c7-8476-b3e2981694ac None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:26.886268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 686/1364] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:26.891632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316e05-dec8-4865-b46d-13a7109c7040 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:26.892116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316e05-dec8-4865-b46d-13a7109c7040 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:26.892116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd316e05-dec8-4865-b46d-13a7109c7040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:26.909534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:26.964064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-bd316e05-dec8-4865-b46d-13a7109c7040 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:26.965479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bd316e05-dec8-4865-b46d-13a7109c7040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:27.070516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 679/1365] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:27.357760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7eb5f-94b2-4384-aa86-d0edc823a8b3 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:27.358080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7eb5f-94b2-4384-aa86-d0edc823a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:27.358436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7eb5f-94b2-4384-aa86-d0edc823a8b3 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:27.360194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 687/1366] 10.222.0.13 () {54 vars in 962 bytes} [Sat Sep 3 03:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:27.366422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6b14-42b7-4c5a-b554-301cd61e5c8f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:27.366781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6b14-42b7-4c5a-b554-301cd61e5c8f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:27.367123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6b14-42b7-4c5a-b554-301cd61e5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:27.462939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7c8c6b14-42b7-4c5a-b554-301cd61e5c8f None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:27.464449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7c8c6b14-42b7-4c5a-b554-301cd61e5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:27.510207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:27.621931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 680/1367] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Sep 3 03:42:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:27.632589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7eb5f-94b2-4384-aa86-d0edc823a8b3 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:27.634525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-27c7eb5f-94b2-4384-aa86-d0edc823a8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:27.826071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7eb5f-94b2-4384-aa86-d0edc823a8b3 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:27.850863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:27.972143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faad486-90ef-4f2d-99b3-cec655297e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:27.972853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad486-90ef-4f2d-99b3-cec655297e36 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:27.973217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad486-90ef-4f2d-99b3-cec655297e36 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:27.973558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad486-90ef-4f2d-99b3-cec655297e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:27.975477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2faad486-90ef-4f2d-99b3-cec655297e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:28.082983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faad486-90ef-4f2d-99b3-cec655297e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:28.084506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faad486-90ef-4f2d-99b3-cec655297e36 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:28.104256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 688/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:28.543605 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278575-4082-491d-bad6-4fd405944cbf None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:28.544713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278575-4082-491d-bad6-4fd405944cbf None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:28.545099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278575-4082-491d-bad6-4fd405944cbf None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:28.546721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 681/1369] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:28.552044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100110a7-170b-4e41-a17d-68a4d8691fb9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:28.552328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100110a7-170b-4e41-a17d-68a4d8691fb9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:28.552631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100110a7-170b-4e41-a17d-68a4d8691fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:28.586880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:28.625072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-100110a7-170b-4e41-a17d-68a4d8691fb9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:28.626515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-100110a7-170b-4e41-a17d-68a4d8691fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:28.737323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 689/1370] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:29.315178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ceb17-f08e-4605-b63c-6be1301247d3 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:29.315443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ceb17-f08e-4605-b63c-6be1301247d3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:29.315753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ceb17-f08e-4605-b63c-6be1301247d3 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:29.317299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 682/1371] 10.222.0.13 () {54 vars in 964 bytes} [Sat Sep 3 03:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:29.323261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8f23-b320-4808-a836-41356423a08b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:29.323897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8f23-b320-4808-a836-41356423a08b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:29.323897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8f23-b320-4808-a836-41356423a08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:29.410474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e3da8f23-b320-4808-a836-41356423a08b None None] MFA Rules not processed for user `21baacaa1f1c4342aacda4c967a6da58`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:29.411833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e3da8f23-b320-4808-a836-41356423a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:29.462732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:29.504976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 690/1372] 10.222.0.13 () {58 vars in 1061 bytes} [Sat Sep 3 03:42:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:29.513668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ceb17-f08e-4605-b63c-6be1301247d3 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:29.515683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6a8ceb17-f08e-4605-b63c-6be1301247d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:29.629602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ceb17-f08e-4605-b63c-6be1301247d3 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:29.675388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:29.712292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c6a9c-142f-4043-bf4c-6b1067ea5b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:29.712957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c6a9c-142f-4043-bf4c-6b1067ea5b88 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:29.713229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c6a9c-142f-4043-bf4c-6b1067ea5b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:29.713421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c6a9c-142f-4043-bf4c-6b1067ea5b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:29.715227 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a84c6a9c-142f-4043-bf4c-6b1067ea5b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:29.843911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c6a9c-142f-4043-bf4c-6b1067ea5b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:29.845435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c6a9c-142f-4043-bf4c-6b1067ea5b88 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:29.866029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 683/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:30.130624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac413-7389-48c1-a360-3ffa7f2dc14c None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:30.130999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac413-7389-48c1-a360-3ffa7f2dc14c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:30.131307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac413-7389-48c1-a360-3ffa7f2dc14c None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:30.132866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 691/1374] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:30.138836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64845-fb64-46ba-9220-d72c2516b402 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:30.139145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64845-fb64-46ba-9220-d72c2516b402 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:30.139441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c64845-fb64-46ba-9220-d72c2516b402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:30.220472 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-52c64845-fb64-46ba-9220-d72c2516b402 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:30.221629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-52c64845-fb64-46ba-9220-d72c2516b402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:30.243492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:30.326205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 684/1375] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:30.619717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac413-7389-48c1-a360-3ffa7f2dc14c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:30.621947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a99ac413-7389-48c1-a360-3ffa7f2dc14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:30.770779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac413-7389-48c1-a360-3ffa7f2dc14c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:30.821605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:30.887708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e65598-368e-43bb-9ee4-4b163e8d8fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:30.888319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65598-368e-43bb-9ee4-4b163e8d8fa2 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:30.888590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65598-368e-43bb-9ee4-4b163e8d8fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:30.888883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65598-368e-43bb-9ee4-4b163e8d8fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:30.890502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c7e65598-368e-43bb-9ee4-4b163e8d8fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:30.981351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e65598-368e-43bb-9ee4-4b163e8d8fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:30.983297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e65598-368e-43bb-9ee4-4b163e8d8fa2 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:31.002300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 692/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:32.917659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945a11-b103-45fd-8ec2-7dbbe4e03904 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:32.918157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945a11-b103-45fd-8ec2-7dbbe4e03904 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:32.918274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8945a11-b103-45fd-8ec2-7dbbe4e03904 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:32.919580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 685/1377] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:32.924965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4e939-3344-4af7-9aaa-d9344cb1f136 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:32.925420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4e939-3344-4af7-9aaa-d9344cb1f136 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:32.925512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4e939-3344-4af7-9aaa-d9344cb1f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:33.003656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e3b4e939-3344-4af7-9aaa-d9344cb1f136 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:33.005287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e3b4e939-3344-4af7-9aaa-d9344cb1f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:33.013255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:33.105435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 693/1378] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:42:33.394184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8945a11-b103-45fd-8ec2-7dbbe4e03904 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:33.395731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b8945a11-b103-45fd-8ec2-7dbbe4e03904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:33.592382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8945a11-b103-45fd-8ec2-7dbbe4e03904 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:33.596521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:33.719054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6bd74-11b2-4750-84db-a5f995f91adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:33.719668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bd74-11b2-4750-84db-a5f995f91adc service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:33.719951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bd74-11b2-4750-84db-a5f995f91adc service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:33.720226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6bd74-11b2-4750-84db-a5f995f91adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:33.721856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-dfa6bd74-11b2-4750-84db-a5f995f91adc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:33.815896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6bd74-11b2-4750-84db-a5f995f91adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:33.817532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6bd74-11b2-4750-84db-a5f995f91adc service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:33.836729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 686/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:35.793502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a679cf-4491-4ca1-bb3a-a985eb460e11 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:35.794085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a679cf-4491-4ca1-bb3a-a985eb460e11 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:35.794085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a679cf-4491-4ca1-bb3a-a985eb460e11 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:35.795656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 694/1380] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:35.800953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab285-a598-4943-86a1-a9721900b7ea None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:35.801403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab285-a598-4943-86a1-a9721900b7ea None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:35.801667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab285-a598-4943-86a1-a9721900b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:35.813423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:35.885104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f16ab285-a598-4943-86a1-a9721900b7ea None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:35.886343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f16ab285-a598-4943-86a1-a9721900b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:35.997048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 687/1381] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:36.291159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a679cf-4491-4ca1-bb3a-a985eb460e11 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:36.292879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e8a679cf-4491-4ca1-bb3a-a985eb460e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:36.443960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:36.458293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a679cf-4491-4ca1-bb3a-a985eb460e11 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:36.579246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8691a5-cad9-4ee2-88ca-b063030debc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:36.579754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8691a5-cad9-4ee2-88ca-b063030debc8 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:36.580034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8691a5-cad9-4ee2-88ca-b063030debc8 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:36.580301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8691a5-cad9-4ee2-88ca-b063030debc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:36.581900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ba8691a5-cad9-4ee2-88ca-b063030debc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:36.680250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8691a5-cad9-4ee2-88ca-b063030debc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:36.681891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8691a5-cad9-4ee2-88ca-b063030debc8 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:36.693824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:36.703704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 695/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:38.681376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae6b7-0683-406c-8298-2b255ea54a15 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:38.681942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae6b7-0683-406c-8298-2b255ea54a15 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:38.681942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ae6b7-0683-406c-8298-2b255ea54a15 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:38.683910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 688/1383] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:38.689585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a070760-6480-4ab0-ad08-4f62938423d6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:38.690034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a070760-6480-4ab0-ad08-4f62938423d6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:38.690126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a070760-6480-4ab0-ad08-4f62938423d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:38.761042 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-3a070760-6480-4ab0-ad08-4f62938423d6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:38.762509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3a070760-6480-4ab0-ad08-4f62938423d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:38.867851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 696/1384] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:39.154263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ae6b7-0683-406c-8298-2b255ea54a15 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:39.156248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-674ae6b7-0683-406c-8298-2b255ea54a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:39.254853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:39.330324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ae6b7-0683-406c-8298-2b255ea54a15 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:39.445954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ed66e-1bb0-4b5f-a8e0-ef16e78fb54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:39.446493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ed66e-1bb0-4b5f-a8e0-ef16e78fb54b service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:39.446776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ed66e-1bb0-4b5f-a8e0-ef16e78fb54b service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:39.447049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ed66e-1bb0-4b5f-a8e0-ef16e78fb54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:39.448796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-be9ed66e-1bb0-4b5f-a8e0-ef16e78fb54b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:39.521301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:39.568644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ed66e-1bb0-4b5f-a8e0-ef16e78fb54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:39.570353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ed66e-1bb0-4b5f-a8e0-ef16e78fb54b service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:39.590431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 689/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:42:41.953547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7aa71-d1af-4adc-8ad3-bc80d149f19c None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:41.954188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7aa71-d1af-4adc-8ad3-bc80d149f19c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:41.954188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7aa71-d1af-4adc-8ad3-bc80d149f19c None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:41.955565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 697/1386] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:41.962348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747b7fa-1aba-4db0-9558-ca90a086d031 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:41.962829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747b7fa-1aba-4db0-9558-ca90a086d031 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:41.963097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747b7fa-1aba-4db0-9558-ca90a086d031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:42.046949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5747b7fa-1aba-4db0-9558-ca90a086d031 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:42.048448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5747b7fa-1aba-4db0-9558-ca90a086d031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:42.172959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 690/1387] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:42.541220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7aa71-d1af-4adc-8ad3-bc80d149f19c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:42.543389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-77e7aa71-d1af-4adc-8ad3-bc80d149f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:42.634705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:42.751014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7aa71-d1af-4adc-8ad3-bc80d149f19c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:42.890328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777235a2-6c0c-4328-a1eb-f7b78a2e94a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:42.891219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777235a2-6c0c-4328-a1eb-f7b78a2e94a3 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:42.891548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777235a2-6c0c-4328-a1eb-f7b78a2e94a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:42.891782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777235a2-6c0c-4328-a1eb-f7b78a2e94a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:42.893426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-777235a2-6c0c-4328-a1eb-f7b78a2e94a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:42.957134 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:43.016183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777235a2-6c0c-4328-a1eb-f7b78a2e94a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:43.017823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777235a2-6c0c-4328-a1eb-f7b78a2e94a3 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:43.036513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 698/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:44.834461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bb2f-155b-43c0-909a-ad1fa58edc06 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:44.835029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bb2f-155b-43c0-909a-ad1fa58edc06 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:44.835029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bb2f-155b-43c0-909a-ad1fa58edc06 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:44.836394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 691/1389] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:44.841899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c940d9-b28b-447d-bf45-1c7d412f45c2 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:44.842372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c940d9-b28b-447d-bf45-1c7d412f45c2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:44.842474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c940d9-b28b-447d-bf45-1c7d412f45c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:44.911035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-66c940d9-b28b-447d-bf45-1c7d412f45c2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:44.912304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-66c940d9-b28b-447d-bf45-1c7d412f45c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:44.969969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe455c3-b54d-4e74-b7f1-8514bb0d7358 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:44.970220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe455c3-b54d-4e74-b7f1-8514bb0d7358 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:44.970475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe455c3-b54d-4e74-b7f1-8514bb0d7358 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:44.971854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 692/1390] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:42:44.977002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff07e02-3130-40ac-a7d0-862bbb9cd954 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:44.977361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff07e02-3130-40ac-a7d0-862bbb9cd954 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:44.977668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff07e02-3130-40ac-a7d0-862bbb9cd954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:45.014565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 699/1391] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:45.015288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:45.047356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-eff07e02-3130-40ac-a7d0-862bbb9cd954 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:45.048585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-eff07e02-3130-40ac-a7d0-862bbb9cd954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:45.147274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 693/1392] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:45.307335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948676-d047-42af-9a70-e4b620701d83 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:45.308110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948676-d047-42af-9a70-e4b620701d83 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:45.308412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74948676-d047-42af-9a70-e4b620701d83 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:45.309811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 700/1393] 10.222.0.13 () {54 vars in 961 bytes} [Sat Sep 3 03:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:45.314786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390587c-9df7-4abe-bc1a-5b322bcf3a21 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:45.315076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390587c-9df7-4abe-bc1a-5b322bcf3a21 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:45.315344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390587c-9df7-4abe-bc1a-5b322bcf3a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:45.400667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-b390587c-9df7-4abe-bc1a-5b322bcf3a21 None None] MFA Rules not processed for user `22a017e6b1d64044b4f5e3fb67cfd67f`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:45.402011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b390587c-9df7-4abe-bc1a-5b322bcf3a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:45.431175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74948676-d047-42af-9a70-e4b620701d83 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:45.432716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-74948676-d047-42af-9a70-e4b620701d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:45.447220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:45.454040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:45.483510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 694/1394] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Sep 3 03:42:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:42:45.491031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390587c-9df7-4abe-bc1a-5b322bcf3a21 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:45.500076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390587c-9df7-4abe-bc1a-5b322bcf3a21 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:45.574203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55c97d-96de-4504-99e8-c63f002db6bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22a017e6b1d64044b4f5e3fb67cfd67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:45.574843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55c97d-96de-4504-99e8-c63f002db6bb service glance] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:45.575138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55c97d-96de-4504-99e8-c63f002db6bb service glance] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:45.575406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55c97d-96de-4504-99e8-c63f002db6bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:45.577061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ee55c97d-96de-4504-99e8-c63f002db6bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:45.589121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74948676-d047-42af-9a70-e4b620701d83 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:45.683380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:45.687684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55c97d-96de-4504-99e8-c63f002db6bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:45.689208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55c97d-96de-4504-99e8-c63f002db6bb service glance] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:45.703660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:45.709373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 695/1395] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:45.711504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179258b-09fa-499b-9242-685ae4241dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:45.712119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179258b-09fa-499b-9242-685ae4241dbe service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:45.712401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179258b-09fa-499b-9242-685ae4241dbe service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:45.712672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179258b-09fa-499b-9242-685ae4241dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:45.714586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3179258b-09fa-499b-9242-685ae4241dbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:45.805627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179258b-09fa-499b-9242-685ae4241dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:45.807235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179258b-09fa-499b-9242-685ae4241dbe service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:45.826008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 701/1396] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:42:46.464309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35e0d1-2194-416a-bf7c-ebed7e0abd0a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:46.464789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35e0d1-2194-416a-bf7c-ebed7e0abd0a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:46.464895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35e0d1-2194-416a-bf7c-ebed7e0abd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:46.534251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6c35e0d1-2194-416a-bf7c-ebed7e0abd0a None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:46.535453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6c35e0d1-2194-416a-bf7c-ebed7e0abd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:46.625829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 696/1397] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:42:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:46.672815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad0ac-39a1-4173-af3a-2fa4711e878a None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:46.673323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad0ac-39a1-4173-af3a-2fa4711e878a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:46.673557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad0ac-39a1-4173-af3a-2fa4711e878a None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:46.675029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 702/1398] 10.222.0.13 () {54 vars in 943 bytes} [Sat Sep 3 03:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:46.682000 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc812a-f410-44d3-ad8b-e4c2a0ff5d5d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:46.682377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc812a-f410-44d3-ad8b-e4c2a0ff5d5d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:46.682745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc812a-f410-44d3-ad8b-e4c2a0ff5d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:46.757611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f6bc812a-f410-44d3-ad8b-e4c2a0ff5d5d None None] MFA Rules not processed for user `fe8b2e7f400346f3bcfdedeed017e6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:46.758801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f6bc812a-f410-44d3-ad8b-e4c2a0ff5d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:46.786946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:46.865253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 697/1399] 10.222.0.13 () {58 vars in 1040 bytes} [Sat Sep 3 03:42:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:46.874589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad0ac-39a1-4173-af3a-2fa4711e878a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:46.876124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a3cad0ac-39a1-4173-af3a-2fa4711e878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:46.984346 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:47.027630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad0ac-39a1-4173-af3a-2fa4711e878a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:47.132676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f16c12-1a45-4dc5-b92f-7559b3a0bd19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:47.133273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16c12-1a45-4dc5-b92f-7559b3a0bd19 service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:47.133546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16c12-1a45-4dc5-b92f-7559b3a0bd19 service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:47.133811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16c12-1a45-4dc5-b92f-7559b3a0bd19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:47.135408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a2f16c12-1a45-4dc5-b92f-7559b3a0bd19 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:47.222286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16c12-1a45-4dc5-b92f-7559b3a0bd19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:47.223911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16c12-1a45-4dc5-b92f-7559b3a0bd19 service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:47.227528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:47.235851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 703/1400] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:42:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:42:47.767464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc529f9-2598-4caa-9aec-956ac7188d94 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:47.767464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc529f9-2598-4caa-9aec-956ac7188d94 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:47.767464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc529f9-2598-4caa-9aec-956ac7188d94 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:47.770205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 698/1401] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:47.773904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0768d-cc64-4160-b4a4-5d2436eddc15 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:47.774430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0768d-cc64-4160-b4a4-5d2436eddc15 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:47.774522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0768d-cc64-4160-b4a4-5d2436eddc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:47.845287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e3e0768d-cc64-4160-b4a4-5d2436eddc15 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:47.846806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e3e0768d-cc64-4160-b4a4-5d2436eddc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:47.956883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 704/1402] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:48.245056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc529f9-2598-4caa-9aec-956ac7188d94 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:48.246594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3bc529f9-2598-4caa-9aec-956ac7188d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:48.414150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc529f9-2598-4caa-9aec-956ac7188d94 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:48.417758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:48.550529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79488a9-dd18-489c-a856-614e2e02eb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:48.551143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79488a9-dd18-489c-a856-614e2e02eb03 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:48.551424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79488a9-dd18-489c-a856-614e2e02eb03 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:48.561304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79488a9-dd18-489c-a856-614e2e02eb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:48.561304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c79488a9-dd18-489c-a856-614e2e02eb03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:48.678148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79488a9-dd18-489c-a856-614e2e02eb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:48.679675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79488a9-dd18-489c-a856-614e2e02eb03 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:48.699710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 699/1403] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:50.720224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bf30f-60db-43be-8d7b-3d11f6956302 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:50.720815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bf30f-60db-43be-8d7b-3d11f6956302 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:50.720815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bf30f-60db-43be-8d7b-3d11f6956302 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:50.722304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 705/1404] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:50.727678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dfe91-d1dc-49bb-a862-6a3c690d3dd8 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:50.728104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dfe91-d1dc-49bb-a862-6a3c690d3dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:50.728255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dfe91-d1dc-49bb-a862-6a3c690d3dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:50.738628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:50.802209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-162dfe91-d1dc-49bb-a862-6a3c690d3dd8 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:50.803477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-162dfe91-d1dc-49bb-a862-6a3c690d3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:50.913829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 700/1405] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:51.202685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bf30f-60db-43be-8d7b-3d11f6956302 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:51.204292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fd4bf30f-60db-43be-8d7b-3d11f6956302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:51.296849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:51.368846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bf30f-60db-43be-8d7b-3d11f6956302 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:51.497444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05a9ce-3c13-4dc9-913d-c5d30f6b2bf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:51.498058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a9ce-3c13-4dc9-913d-c5d30f6b2bf3 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:51.500287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a9ce-3c13-4dc9-913d-c5d30f6b2bf3 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:51.500589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a9ce-3c13-4dc9-913d-c5d30f6b2bf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:51.502256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8f05a9ce-3c13-4dc9-913d-c5d30f6b2bf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:51.554859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:51.614137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05a9ce-3c13-4dc9-913d-c5d30f6b2bf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:51.615775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05a9ce-3c13-4dc9-913d-c5d30f6b2bf3 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:51.640594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 706/1406] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:42:53.591359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f0b9-e76c-43c4-ae53-eac3b9be3e4e None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:53.591889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f0b9-e76c-43c4-ae53-eac3b9be3e4e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:53.591889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f0b9-e76c-43c4-ae53-eac3b9be3e4e None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:53.593211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 701/1407] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:42:53.599436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec561-d8e3-4c38-b50c-371f42498e55 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:53.599436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec561-d8e3-4c38-b50c-371f42498e55 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:53.599436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ec561-d8e3-4c38-b50c-371f42498e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:53.679548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f68ec561-d8e3-4c38-b50c-371f42498e55 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:42:53.680756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f68ec561-d8e3-4c38-b50c-371f42498e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:53.795926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 707/1408] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:42:54.139685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f0b9-e76c-43c4-ae53-eac3b9be3e4e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:42:54.141293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6489f0b9-e76c-43c4-ae53-eac3b9be3e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:54.230475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:54.298892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f0b9-e76c-43c4-ae53-eac3b9be3e4e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:42:54.428875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b73c6c-f801-472b-9e7c-be031bb6f025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:42:54.429713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73c6c-f801-472b-9e7c-be031bb6f025 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:42:54.429994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73c6c-f801-472b-9e7c-be031bb6f025 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:42:54.430265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b73c6c-f801-472b-9e7c-be031bb6f025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:42:54.431903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-84b73c6c-f801-472b-9e7c-be031bb6f025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:42:54.487299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:42:54.534593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b73c6c-f801-472b-9e7c-be031bb6f025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:42:54.536237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b73c6c-f801-472b-9e7c-be031bb6f025 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:42:54.556499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 702/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:03.794158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=93 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:04.554451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=24 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:09.493864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e8d3-10a5-4c26-b2ee-b289eaabdb88 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:09.494533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e8d3-10a5-4c26-b2ee-b289eaabdb88 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:09.494533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140e8d3-10a5-4c26-b2ee-b289eaabdb88 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:09.495797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 708/1410] 10.222.0.13 () {54 vars in 918 bytes} [Sat Sep 3 03:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:09.501247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221670f-15da-43df-ab5d-eb2ffa59ab4e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:09.501770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221670f-15da-43df-ab5d-eb2ffa59ab4e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:09.501770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221670f-15da-43df-ab5d-eb2ffa59ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:09.578383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d221670f-15da-43df-ab5d-eb2ffa59ab4e None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:09.579617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d221670f-15da-43df-ab5d-eb2ffa59ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:09.696654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 703/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Sat Sep 3 03:43:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:09.711751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fc43d-a093-48c4-adf0-a9f0a2e1771c None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:09.712041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fc43d-a093-48c4-adf0-a9f0a2e1771c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:09.712311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fc43d-a093-48c4-adf0-a9f0a2e1771c None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:09.713767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 709/1412] 10.222.0.13 () {54 vars in 918 bytes} [Sat Sep 3 03:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:09.718536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a33e25-0f8a-49ab-b1d7-3e9d9d2ff3e8 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:09.718915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a33e25-0f8a-49ab-b1d7-3e9d9d2ff3e8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:09.719220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a33e25-0f8a-49ab-b1d7-3e9d9d2ff3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:09.800897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:09.804640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-05a33e25-0f8a-49ab-b1d7-3e9d9d2ff3e8 None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:09.806573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-05a33e25-0f8a-49ab-b1d7-3e9d9d2ff3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:09.926949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 704/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Sat Sep 3 03:43:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:12.320957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da88d9-3a01-4bba-8ac2-c60d84d53c3b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:12.321509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da88d9-3a01-4bba-8ac2-c60d84d53c3b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:12.321509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da88d9-3a01-4bba-8ac2-c60d84d53c3b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:12.323270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:12.329946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10f3c-a64c-4a14-9ae6-94ab528496d0 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:12.330351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10f3c-a64c-4a14-9ae6-94ab528496d0 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:12.330549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10f3c-a64c-4a14-9ae6-94ab528496d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:12.403470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-b6d10f3c-a64c-4a14-9ae6-94ab528496d0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:12.404709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b6d10f3c-a64c-4a14-9ae6-94ab528496d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:12.467652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:12.517504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:12.810377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da88d9-3a01-4bba-8ac2-c60d84d53c3b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:12.812645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f8da88d9-3a01-4bba-8ac2-c60d84d53c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:12.979004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da88d9-3a01-4bba-8ac2-c60d84d53c3b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:13.066963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:13.108779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe1d9c-979d-41e9-8c42-f74e6ba9cee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:13.109413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe1d9c-979d-41e9-8c42-f74e6ba9cee7 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:13.109701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe1d9c-979d-41e9-8c42-f74e6ba9cee7 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:13.109968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe1d9c-979d-41e9-8c42-f74e6ba9cee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:13.111579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-babe1d9c-979d-41e9-8c42-f74e6ba9cee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:13.203828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe1d9c-979d-41e9-8c42-f74e6ba9cee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:13.205458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe1d9c-979d-41e9-8c42-f74e6ba9cee7 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:13.224311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 711/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:14.123852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334cccc-7c09-4cf7-835c-f34112f6f9d7 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:14.124458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334cccc-7c09-4cf7-835c-f34112f6f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:14.124458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334cccc-7c09-4cf7-835c-f34112f6f9d7 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:14.125813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:14.132142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068780ba-14f2-4a91-8ec9-2120f30b2a03 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:14.132686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068780ba-14f2-4a91-8ec9-2120f30b2a03 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:14.132686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068780ba-14f2-4a91-8ec9-2120f30b2a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:14.225566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-068780ba-14f2-4a91-8ec9-2120f30b2a03 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:14.226875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-068780ba-14f2-4a91-8ec9-2120f30b2a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:14.254654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:14.326288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:14.477972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334cccc-7c09-4cf7-835c-f34112f6f9d7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:14.480288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d334cccc-7c09-4cf7-835c-f34112f6f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:14.649606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334cccc-7c09-4cf7-835c-f34112f6f9d7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:14.692153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:14.772851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de952d5a-8910-42d5-ba56-7cace91b223f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:14.773405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de952d5a-8910-42d5-ba56-7cace91b223f service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:14.773683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de952d5a-8910-42d5-ba56-7cace91b223f service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:14.773946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de952d5a-8910-42d5-ba56-7cace91b223f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:14.775641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-de952d5a-8910-42d5-ba56-7cace91b223f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:14.871589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de952d5a-8910-42d5-ba56-7cace91b223f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:14.873199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de952d5a-8910-42d5-ba56-7cace91b223f service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:14.891831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 707/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:15.778617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf30a9-1575-4fba-8cff-47bbd0376b98 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:15.779541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf30a9-1575-4fba-8cff-47bbd0376b98 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:15.779541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf30a9-1575-4fba-8cff-47bbd0376b98 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:15.781621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:15.790050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfa55-a433-40e4-9a06-2605601669ae None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:15.790525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfa55-a433-40e4-9a06-2605601669ae None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:15.790622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfa55-a433-40e4-9a06-2605601669ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:15.852253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:15.876288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e5bdfa55-a433-40e4-9a06-2605601669ae None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:15.877535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e5bdfa55-a433-40e4-9a06-2605601669ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:15.976734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:16.129669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf30a9-1575-4fba-8cff-47bbd0376b98 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:16.131717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2dbf30a9-1575-4fba-8cff-47bbd0376b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:16.287581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf30a9-1575-4fba-8cff-47bbd0376b98 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:16.300044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:16.411828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3efd-cf1c-437a-a393-869d9aca9e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:16.412441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3efd-cf1c-437a-a393-869d9aca9e43 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:16.412713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3efd-cf1c-437a-a393-869d9aca9e43 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:16.413010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3efd-cf1c-437a-a393-869d9aca9e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:16.414632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d9dd3efd-cf1c-437a-a393-869d9aca9e43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:16.520701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3efd-cf1c-437a-a393-869d9aca9e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:16.522339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3efd-cf1c-437a-a393-869d9aca9e43 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:16.541299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 714/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:17.403374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba7380-3166-4606-97c9-a50649e7fe31 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:17.403959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba7380-3166-4606-97c9-a50649e7fe31 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:17.403959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba7380-3166-4606-97c9-a50649e7fe31 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:17.406035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:17.413534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b8394-9d97-46b6-acd2-071a97e156e5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:17.413973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b8394-9d97-46b6-acd2-071a97e156e5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:17.413973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b8394-9d97-46b6-acd2-071a97e156e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:17.435171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:17.497440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-483b8394-9d97-46b6-acd2-071a97e156e5 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:17.498646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-483b8394-9d97-46b6-acd2-071a97e156e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:17.601952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:43:17.757814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba7380-3166-4606-97c9-a50649e7fe31 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:17.760152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-00ba7380-3166-4606-97c9-a50649e7fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:17.902405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:17.940990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba7380-3166-4606-97c9-a50649e7fe31 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:18.063894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be49af-636e-4058-8c6e-b0db26dc14c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:18.064422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be49af-636e-4058-8c6e-b0db26dc14c6 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:18.064708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be49af-636e-4058-8c6e-b0db26dc14c6 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:18.065012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be49af-636e-4058-8c6e-b0db26dc14c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:18.066633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e8be49af-636e-4058-8c6e-b0db26dc14c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:18.159775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:18.176397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be49af-636e-4058-8c6e-b0db26dc14c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:18.178046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be49af-636e-4058-8c6e-b0db26dc14c6 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:18.197689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 710/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:19.067183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b14b4-3c3a-4d09-9162-cacf0d678268 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:19.068043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b14b4-3c3a-4d09-9162-cacf0d678268 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:19.068043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b14b4-3c3a-4d09-9162-cacf0d678268 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:19.070223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:19.076114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238dde-fe71-4357-b381-98eb1e145695 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:19.076847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238dde-fe71-4357-b381-98eb1e145695 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:19.077034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e238dde-fe71-4357-b381-98eb1e145695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:19.175523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5e238dde-fe71-4357-b381-98eb1e145695 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:19.176738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5e238dde-fe71-4357-b381-98eb1e145695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:19.279645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:19.444300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b14b4-3c3a-4d09-9162-cacf0d678268 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:19.445860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9b9b14b4-3c3a-4d09-9162-cacf0d678268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:19.543083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:19.612264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b14b4-3c3a-4d09-9162-cacf0d678268 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:19.755832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a2c12-89ea-4d94-be30-8f13d4f384dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:19.756522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2c12-89ea-4d94-be30-8f13d4f384dd service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:19.756880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2c12-89ea-4d94-be30-8f13d4f384dd service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:19.757229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a2c12-89ea-4d94-be30-8f13d4f384dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:19.759978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d10a2c12-89ea-4d94-be30-8f13d4f384dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:19.812494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:19.855114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a2c12-89ea-4d94-be30-8f13d4f384dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:19.856701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a2c12-89ea-4d94-be30-8f13d4f384dd service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:19.876740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 717/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:20.692498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444445f9-f87a-4e9f-b9ff-9780909670a3 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:20.693149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444445f9-f87a-4e9f-b9ff-9780909670a3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:20.693149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444445f9-f87a-4e9f-b9ff-9780909670a3 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:20.694420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:20.699896 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678c339-17d9-4b67-a76d-7419e6df7207 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:20.700364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678c339-17d9-4b67-a76d-7419e6df7207 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:20.700481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678c339-17d9-4b67-a76d-7419e6df7207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:20.784481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0678c339-17d9-4b67-a76d-7419e6df7207 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:20.785724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0678c339-17d9-4b67-a76d-7419e6df7207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:20.891429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:21.042360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444445f9-f87a-4e9f-b9ff-9780909670a3 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:21.043930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-444445f9-f87a-4e9f-b9ff-9780909670a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:21.102087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:21.216100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444445f9-f87a-4e9f-b9ff-9780909670a3 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:21.340839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabae27-7cf6-4ed1-9cc3-549ce02a5c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:21.341388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabae27-7cf6-4ed1-9cc3-549ce02a5c89 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:21.341669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabae27-7cf6-4ed1-9cc3-549ce02a5c89 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:21.341933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabae27-7cf6-4ed1-9cc3-549ce02a5c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:21.343546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5aabae27-7cf6-4ed1-9cc3-549ce02a5c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:21.351073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:21.439506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabae27-7cf6-4ed1-9cc3-549ce02a5c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:21.441171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabae27-7cf6-4ed1-9cc3-549ce02a5c89 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:21.459951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 713/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:22.285593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f968-f681-436f-9ffc-371aba7e2a34 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:22.286507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f968-f681-436f-9ffc-371aba7e2a34 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:22.286507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4f968-f681-436f-9ffc-371aba7e2a34 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:22.288682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:22.295051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9a0a-9768-4f16-905a-7f5b4fe0ef31 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:22.295864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9a0a-9768-4f16-905a-7f5b4fe0ef31 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:22.296044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e9a0a-9768-4f16-905a-7f5b4fe0ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:22.385196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0e2e9a0a-9768-4f16-905a-7f5b4fe0ef31 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:22.386739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0e2e9a0a-9768-4f16-905a-7f5b4fe0ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:22.459733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:22.503529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:22.656110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4f968-f681-436f-9ffc-371aba7e2a34 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:22.657694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e2d4f968-f681-436f-9ffc-371aba7e2a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:22.675954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:22.812698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4f968-f681-436f-9ffc-371aba7e2a34 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:22.913621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:22.941982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226645a-c157-4a1a-b781-bf44c636a93d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:22.942593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226645a-c157-4a1a-b781-bf44c636a93d service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:22.942871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226645a-c157-4a1a-b781-bf44c636a93d service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:22.943104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226645a-c157-4a1a-b781-bf44c636a93d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:22.944746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3226645a-c157-4a1a-b781-bf44c636a93d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:23.050197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226645a-c157-4a1a-b781-bf44c636a93d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:23.051839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226645a-c157-4a1a-b781-bf44c636a93d service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:23.070386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 720/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:23.883015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4743e5-b996-4843-82b8-1b4ec27a82df None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:23.883574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4743e5-b996-4843-82b8-1b4ec27a82df None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:23.883574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4743e5-b996-4843-82b8-1b4ec27a82df None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:23.884879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:23.890906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee4aa-638a-4bf8-b838-c4bb384614c2 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:23.891354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee4aa-638a-4bf8-b838-c4bb384614c2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:23.891462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fee4aa-638a-4bf8-b838-c4bb384614c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:23.977730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a3fee4aa-638a-4bf8-b838-c4bb384614c2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:23.978930 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a3fee4aa-638a-4bf8-b838-c4bb384614c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:24.022332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:24.081649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:24.233673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4743e5-b996-4843-82b8-1b4ec27a82df None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:24.235883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6e4743e5-b996-4843-82b8-1b4ec27a82df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:24.403011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4743e5-b996-4843-82b8-1b4ec27a82df None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:24.458521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:24.518620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff863-03c9-4ed5-9ad9-dfb506fdf455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:24.519226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff863-03c9-4ed5-9ad9-dfb506fdf455 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:24.519500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff863-03c9-4ed5-9ad9-dfb506fdf455 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:24.519765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff863-03c9-4ed5-9ad9-dfb506fdf455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:24.521392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ee3ff863-03c9-4ed5-9ad9-dfb506fdf455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:24.623125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff863-03c9-4ed5-9ad9-dfb506fdf455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:24.624746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff863-03c9-4ed5-9ad9-dfb506fdf455 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:24.645380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 716/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:25.453307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac170d5-2473-4c31-852c-acd06ecc2c59 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:25.454145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac170d5-2473-4c31-852c-acd06ecc2c59 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:25.454145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac170d5-2473-4c31-852c-acd06ecc2c59 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:25.456226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:43:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:25.464007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee867614-6036-4de1-be09-b6821d3365b3 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:25.464441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee867614-6036-4de1-be09-b6821d3365b3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:25.464550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee867614-6036-4de1-be09-b6821d3365b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:25.548309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ee867614-6036-4de1-be09-b6821d3365b3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:25.549561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ee867614-6036-4de1-be09-b6821d3365b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:25.551595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:25.651721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:25.813450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac170d5-2473-4c31-852c-acd06ecc2c59 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:25.815786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6ac170d5-2473-4c31-852c-acd06ecc2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:25.979351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac170d5-2473-4c31-852c-acd06ecc2c59 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:26.005975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:26.095733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b15ff-2025-41b1-9e4d-b22648f765ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:26.096244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b15ff-2025-41b1-9e4d-b22648f765ee service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:26.096516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b15ff-2025-41b1-9e4d-b22648f765ee service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:26.096779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b15ff-2025-41b1-9e4d-b22648f765ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:26.098408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9b0b15ff-2025-41b1-9e4d-b22648f765ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:26.199033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b15ff-2025-41b1-9e4d-b22648f765ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:26.200645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b15ff-2025-41b1-9e4d-b22648f765ee service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:26.219184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 723/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:28.045871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144ebe-86af-469f-bff4-b293a42f985f None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:28.046438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144ebe-86af-469f-bff4-b293a42f985f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:28.046438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144ebe-86af-469f-bff4-b293a42f985f None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:28.047774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:28.054395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075548-a568-477b-98c6-e4e1e0af4da9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:28.055150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075548-a568-477b-98c6-e4e1e0af4da9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:28.055348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2075548-a568-477b-98c6-e4e1e0af4da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:28.104815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:28.139000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a2075548-a568-477b-98c6-e4e1e0af4da9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:28.140235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a2075548-a568-477b-98c6-e4e1e0af4da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:28.255556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:28.555535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad144ebe-86af-469f-bff4-b293a42f985f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:28.557508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ad144ebe-86af-469f-bff4-b293a42f985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:28.668229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad144ebe-86af-469f-bff4-b293a42f985f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:28.701471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:28.746213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e096cb-ce81-484e-8bab-13ba880acd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:28.746858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e096cb-ce81-484e-8bab-13ba880acd2f service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:28.747152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e096cb-ce81-484e-8bab-13ba880acd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:28.747416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e096cb-ce81-484e-8bab-13ba880acd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:28.749079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-78e096cb-ce81-484e-8bab-13ba880acd2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:28.868110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e096cb-ce81-484e-8bab-13ba880acd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:28.869557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e096cb-ce81-484e-8bab-13ba880acd2f service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:28.889314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 719/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:43:30.947901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5a25-7ace-441b-9555-53a307291c2d None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:30.948518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5a25-7ace-441b-9555-53a307291c2d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:30.948518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5a25-7ace-441b-9555-53a307291c2d None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:30.949978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:30.956240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d829150-2b78-4338-a6f2-e7638729c55f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:30.956679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d829150-2b78-4338-a6f2-e7638729c55f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:30.956782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d829150-2b78-4338-a6f2-e7638729c55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:31.028140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0d829150-2b78-4338-a6f2-e7638729c55f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:31.029390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0d829150-2b78-4338-a6f2-e7638729c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:31.042588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:31.127724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:31.409960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5a25-7ace-441b-9555-53a307291c2d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:31.412407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b22d5a25-7ace-441b-9555-53a307291c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:31.528285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5a25-7ace-441b-9555-53a307291c2d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:31.541413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:31.604928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432b5fa-7d55-43f9-8a6f-202e39c86c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:31.605548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b5fa-7d55-43f9-8a6f-202e39c86c67 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:31.605821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b5fa-7d55-43f9-8a6f-202e39c86c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:31.606089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b5fa-7d55-43f9-8a6f-202e39c86c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:31.607996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c432b5fa-7d55-43f9-8a6f-202e39c86c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:31.719348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432b5fa-7d55-43f9-8a6f-202e39c86c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:31.720743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432b5fa-7d55-43f9-8a6f-202e39c86c67 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:31.742477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 726/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:33.999597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd99f5-2a99-46ea-84c2-4102a29379c6 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:34.000512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd99f5-2a99-46ea-84c2-4102a29379c6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:34.000512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd99f5-2a99-46ea-84c2-4102a29379c6 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:34.002596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:34.010976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402f746-0685-40d2-9b25-d7fcf4098f6b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:34.011414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402f746-0685-40d2-9b25-d7fcf4098f6b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:34.011519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402f746-0685-40d2-9b25-d7fcf4098f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:34.063669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:34.084012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2402f746-0685-40d2-9b25-d7fcf4098f6b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:34.085254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2402f746-0685-40d2-9b25-d7fcf4098f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:34.184795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:34.467343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd99f5-2a99-46ea-84c2-4102a29379c6 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:34.468956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fbbd99f5-2a99-46ea-84c2-4102a29379c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:34.581825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd99f5-2a99-46ea-84c2-4102a29379c6 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:34.630047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:34.668505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2161ea-d468-43c0-a037-d0a538e75d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:34.669140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2161ea-d468-43c0-a037-d0a538e75d03 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:34.669417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2161ea-d468-43c0-a037-d0a538e75d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:34.669684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2161ea-d468-43c0-a037-d0a538e75d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:34.671283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6e2161ea-d468-43c0-a037-d0a538e75d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:34.793517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2161ea-d468-43c0-a037-d0a538e75d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:34.794888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2161ea-d468-43c0-a037-d0a538e75d03 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:34.932607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 722/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:43:36.975884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c766083-acd3-4ccc-aa73-7cf8b2f18412 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:36.976717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c766083-acd3-4ccc-aa73-7cf8b2f18412 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:36.976717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c766083-acd3-4ccc-aa73-7cf8b2f18412 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:36.979090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:36.985994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978723e-4216-4af8-9893-ce36aa9897d1 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:36.986423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978723e-4216-4af8-9893-ce36aa9897d1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:36.986578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978723e-4216-4af8-9893-ce36aa9897d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:37.063131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3978723e-4216-4af8-9893-ce36aa9897d1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:37.064403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3978723e-4216-4af8-9893-ce36aa9897d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:37.085292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:37.171702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:37.454473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c766083-acd3-4ccc-aa73-7cf8b2f18412 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:37.456996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7c766083-acd3-4ccc-aa73-7cf8b2f18412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:37.577465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c766083-acd3-4ccc-aa73-7cf8b2f18412 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:37.601328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:37.664583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a346e9-0011-4995-aef7-17672f8ab759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:37.665237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a346e9-0011-4995-aef7-17672f8ab759 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:37.665528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a346e9-0011-4995-aef7-17672f8ab759 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:37.665977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a346e9-0011-4995-aef7-17672f8ab759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:37.667605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-42a346e9-0011-4995-aef7-17672f8ab759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:37.792309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a346e9-0011-4995-aef7-17672f8ab759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:37.793693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a346e9-0011-4995-aef7-17672f8ab759 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:37.812019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 729/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:39.884907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7a66-b307-49a2-bc95-bc8e9f3efe78 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:39.885955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7a66-b307-49a2-bc95-bc8e9f3efe78 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:39.885955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b7a66-b307-49a2-bc95-bc8e9f3efe78 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:39.888121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:39.894389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371042-e04c-4488-a24e-0aa4d8298191 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:39.895107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371042-e04c-4488-a24e-0aa4d8298191 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:39.895256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371042-e04c-4488-a24e-0aa4d8298191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:39.968297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:39.971374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-3f371042-e04c-4488-a24e-0aa4d8298191 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:39.973149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3f371042-e04c-4488-a24e-0aa4d8298191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:40.075714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:40.359808 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b7a66-b307-49a2-bc95-bc8e9f3efe78 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:40.361344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0a5b7a66-b307-49a2-bc95-bc8e9f3efe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:40.468774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b7a66-b307-49a2-bc95-bc8e9f3efe78 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:40.524150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:40.551438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf50c76-6556-40db-bff5-9ca13ccb0ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:40.552052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50c76-6556-40db-bff5-9ca13ccb0ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:40.552332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50c76-6556-40db-bff5-9ca13ccb0ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:40.552602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf50c76-6556-40db-bff5-9ca13ccb0ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:40.554252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4bf50c76-6556-40db-bff5-9ca13ccb0ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:40.678359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50c76-6556-40db-bff5-9ca13ccb0ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:40.679802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf50c76-6556-40db-bff5-9ca13ccb0ab2 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:40.698200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 725/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:43:42.633171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc2f1-5af1-4c26-9bba-258a73f36c3d None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:42.633741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc2f1-5af1-4c26-9bba-258a73f36c3d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:42.633741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc2f1-5af1-4c26-9bba-258a73f36c3d None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:42.635178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:42.642201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17191093-32f5-48c6-baad-c8c958bb884a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:42.642965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17191093-32f5-48c6-baad-c8c958bb884a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:42.643091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17191093-32f5-48c6-baad-c8c958bb884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:42.712599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-17191093-32f5-48c6-baad-c8c958bb884a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:42.713840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-17191093-32f5-48c6-baad-c8c958bb884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:42.747499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:42.827095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:43.116286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc2f1-5af1-4c26-9bba-258a73f36c3d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:43.117886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6aefc2f1-5af1-4c26-9bba-258a73f36c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:43.242123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc2f1-5af1-4c26-9bba-258a73f36c3d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:43.272011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:43.317818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c846f1e-6b5d-4903-ac9e-6450c78c6b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:43.318414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c846f1e-6b5d-4903-ac9e-6450c78c6b85 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:43.318688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c846f1e-6b5d-4903-ac9e-6450c78c6b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:43.318956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c846f1e-6b5d-4903-ac9e-6450c78c6b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:43.320540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8c846f1e-6b5d-4903-ac9e-6450c78c6b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:43.439714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c846f1e-6b5d-4903-ac9e-6450c78c6b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:43.441240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c846f1e-6b5d-4903-ac9e-6450c78c6b85 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:43.459550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 732/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:45.641427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9c034-56fc-4321-8505-5291368a232a None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:45.642002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9c034-56fc-4321-8505-5291368a232a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:45.642002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9c034-56fc-4321-8505-5291368a232a None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:45.643341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:45.648954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e666e8e-b590-4df9-a190-1c224b7e07b5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:45.649381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e666e8e-b590-4df9-a190-1c224b7e07b5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:45.649474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e666e8e-b590-4df9-a190-1c224b7e07b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:45.726256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-9e666e8e-b590-4df9-a190-1c224b7e07b5 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:45.727486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9e666e8e-b590-4df9-a190-1c224b7e07b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:45.736553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:45.828766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:46.110147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9c034-56fc-4321-8505-5291368a232a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:46.112528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-67d9c034-56fc-4321-8505-5291368a232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:46.235866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9c034-56fc-4321-8505-5291368a232a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:46.293013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:46.312702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c160c57-a1d1-41ec-b709-990cdbfb7c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:46.313358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160c57-a1d1-41ec-b709-990cdbfb7c3d service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:46.313630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160c57-a1d1-41ec-b709-990cdbfb7c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:46.313898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c160c57-a1d1-41ec-b709-990cdbfb7c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:46.315497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9c160c57-a1d1-41ec-b709-990cdbfb7c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:46.436664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160c57-a1d1-41ec-b709-990cdbfb7c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:46.438135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c160c57-a1d1-41ec-b709-990cdbfb7c3d service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:46.458025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 728/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:48.392657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf328bd-bc21-42bb-8a1f-76417f549904 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:48.393311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf328bd-bc21-42bb-8a1f-76417f549904 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:48.393311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf328bd-bc21-42bb-8a1f-76417f549904 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:48.394584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:48.401508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a93a0f-5cbb-4121-aff1-e1a6d72ab6e7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:48.401954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a93a0f-5cbb-4121-aff1-e1a6d72ab6e7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:48.402049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a93a0f-5cbb-4121-aff1-e1a6d72ab6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:48.487945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-76a93a0f-5cbb-4121-aff1-e1a6d72ab6e7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:48.489448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-76a93a0f-5cbb-4121-aff1-e1a6d72ab6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:48.534328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:48.603242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:48.950217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf328bd-bc21-42bb-8a1f-76417f549904 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:48.953025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ddf328bd-bc21-42bb-8a1f-76417f549904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:49.098005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf328bd-bc21-42bb-8a1f-76417f549904 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:49.140997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:49.190303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d7cce-7684-44d6-826d-b11d8577e21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:49.195187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7cce-7684-44d6-826d-b11d8577e21c service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:49.195187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7cce-7684-44d6-826d-b11d8577e21c service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:49.195187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d7cce-7684-44d6-826d-b11d8577e21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:49.195187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-093d7cce-7684-44d6-826d-b11d8577e21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:49.333177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d7cce-7684-44d6-826d-b11d8577e21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:49.334638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d7cce-7684-44d6-826d-b11d8577e21c service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:49.359374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 735/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:51.283179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cff4b-2312-44fd-99d4-630389c9cae5 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:51.284092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cff4b-2312-44fd-99d4-630389c9cae5 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:51.284092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cff4b-2312-44fd-99d4-630389c9cae5 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:51.286359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:51.291858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75202de-7963-41f1-9698-12b777bb8b48 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:51.292327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75202de-7963-41f1-9698-12b777bb8b48 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:51.292434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75202de-7963-41f1-9698-12b777bb8b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:51.375702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a75202de-7963-41f1-9698-12b777bb8b48 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:51.376935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a75202de-7963-41f1-9698-12b777bb8b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:51.396210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:51.478073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:51.769158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cff4b-2312-44fd-99d4-630389c9cae5 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:51.771562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-977cff4b-2312-44fd-99d4-630389c9cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:51.901072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cff4b-2312-44fd-99d4-630389c9cae5 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:51.972302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:51.980857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3edf8-0bbf-4275-a941-5b0dad47dc72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:51.981647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3edf8-0bbf-4275-a941-5b0dad47dc72 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:51.982334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3edf8-0bbf-4275-a941-5b0dad47dc72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:51.982711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3edf8-0bbf-4275-a941-5b0dad47dc72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:51.984506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bec3edf8-0bbf-4275-a941-5b0dad47dc72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:52.114599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3edf8-0bbf-4275-a941-5b0dad47dc72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:52.115954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3edf8-0bbf-4275-a941-5b0dad47dc72 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:52.136009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 731/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:43:54.106065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457dbfb-bcc0-4644-86ed-3aa2c5fc7656 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:54.107306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457dbfb-bcc0-4644-86ed-3aa2c5fc7656 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:54.107306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457dbfb-bcc0-4644-86ed-3aa2c5fc7656 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:54.109310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:43:54.115655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d40aa-5b6f-44e3-8c9c-34351947dbea None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:54.116433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d40aa-5b6f-44e3-8c9c-34351947dbea None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:54.116590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d40aa-5b6f-44e3-8c9c-34351947dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:54.192297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5e3d40aa-5b6f-44e3-8c9c-34351947dbea None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:43:54.193568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5e3d40aa-5b6f-44e3-8c9c-34351947dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:54.240676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:54.294683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:43:54.577518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457dbfb-bcc0-4644-86ed-3aa2c5fc7656 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:43:54.580085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0457dbfb-bcc0-4644-86ed-3aa2c5fc7656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:54.695527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457dbfb-bcc0-4644-86ed-3aa2c5fc7656 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:43:54.758269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:43:54.787564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4c8f-140d-4b90-b512-7ee8fab26639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:43:54.788164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4c8f-140d-4b90-b512-7ee8fab26639 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:43:54.788441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4c8f-140d-4b90-b512-7ee8fab26639 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:43:54.788710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4c8f-140d-4b90-b512-7ee8fab26639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:43:54.790401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-007c4c8f-140d-4b90-b512-7ee8fab26639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:43:54.905436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4c8f-140d-4b90-b512-7ee8fab26639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:43:54.906933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4c8f-140d-4b90-b512-7ee8fab26639 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:43:54.925363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 738/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:44:04.292444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=22 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:04.922927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=66 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:14.493506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307506d-ec7f-4ec8-be67-50a8a563ffca None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:14.494102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307506d-ec7f-4ec8-be67-50a8a563ffca None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:14.494102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307506d-ec7f-4ec8-be67-50a8a563ffca None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:14.495369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 733/1471] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:14.501950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04552bf-d3aa-4bda-8ce9-588c718ad98e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:14.502655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04552bf-d3aa-4bda-8ce9-588c718ad98e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:14.502801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04552bf-d3aa-4bda-8ce9-588c718ad98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:14.577955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c04552bf-d3aa-4bda-8ce9-588c718ad98e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:14.579169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c04552bf-d3aa-4bda-8ce9-588c718ad98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:14.682969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 739/1472] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:44:14.978076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a1f61-3a58-4e6c-8725-b14047e31fac None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:14.978458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a1f61-3a58-4e6c-8725-b14047e31fac None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:14.978736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a1f61-3a58-4e6c-8725-b14047e31fac None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:14.980171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 734/1473] 10.222.0.13 () {54 vars in 961 bytes} [Sat Sep 3 03:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:14.987181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbefcd1-0273-4158-9909-90381cd44e49 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:14.987461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbefcd1-0273-4158-9909-90381cd44e49 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:14.987735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbefcd1-0273-4158-9909-90381cd44e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:15.065282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2dbefcd1-0273-4158-9909-90381cd44e49 None None] MFA Rules not processed for user `22a017e6b1d64044b4f5e3fb67cfd67f`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:15.066472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2dbefcd1-0273-4158-9909-90381cd44e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:15.088011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:15.145251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 740/1474] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Sep 3 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:44:15.153065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a1f61-3a58-4e6c-8725-b14047e31fac None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:44:15.154595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-882a1f61-3a58-4e6c-8725-b14047e31fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:15.266107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a1f61-3a58-4e6c-8725-b14047e31fac None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:44:15.340710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b61f2-8359-4af9-b8a0-a2c3c6e6e073 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22a017e6b1d64044b4f5e3fb67cfd67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:44:15.341332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b61f2-8359-4af9-b8a0-a2c3c6e6e073 service glance] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:15.341615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b61f2-8359-4af9-b8a0-a2c3c6e6e073 service glance] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:15.341889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b61f2-8359-4af9-b8a0-a2c3c6e6e073 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:15.343454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bb9b61f2-8359-4af9-b8a0-a2c3c6e6e073 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:15.400541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:15.459477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b61f2-8359-4af9-b8a0-a2c3c6e6e073 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:44:15.460943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b61f2-8359-4af9-b8a0-a2c3c6e6e073 service glance] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:44:15.483208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 735/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:44:17.485936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a58f9-34d8-4f86-88dc-83c99a15fd7b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:17.486710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a58f9-34d8-4f86-88dc-83c99a15fd7b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:17.486710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a58f9-34d8-4f86-88dc-83c99a15fd7b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:17.488821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 741/1476] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:44:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:17.495905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c7b6-55b1-40ab-8de1-306a52a6bb8c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:17.496580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c7b6-55b1-40ab-8de1-306a52a6bb8c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:17.496763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0c7b6-55b1-40ab-8de1-306a52a6bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:17.570148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a6b0c7b6-55b1-40ab-8de1-306a52a6bb8c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:17.571427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a6b0c7b6-55b1-40ab-8de1-306a52a6bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:17.676725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 736/1477] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:44:17.948770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a58f9-34d8-4f86-88dc-83c99a15fd7b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:44:17.951216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4f9a58f9-34d8-4f86-88dc-83c99a15fd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:18.088349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a58f9-34d8-4f86-88dc-83c99a15fd7b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:44:18.140967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:18.190439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caa069-e4a2-441f-b309-9dd69c9373c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:44:18.191049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caa069-e4a2-441f-b309-9dd69c9373c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:18.191324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caa069-e4a2-441f-b309-9dd69c9373c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:18.191587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caa069-e4a2-441f-b309-9dd69c9373c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:18.192221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caa069-e4a2-441f-b309-9dd69c9373c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:44:18.194041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-f9caa069-e4a2-441f-b309-9dd69c9373c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:44:18.194041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:44:18.194041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:44:18.195182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9caa069-e4a2-441f-b309-9dd69c9373c3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:44:18.214494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 742/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Sat Sep 3 03:44:17 2022] GET /identity/v3/projects => generated 2553 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:44:20.129075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83840-869a-4dfd-b196-d57389eb9a30 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:20.129939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83840-869a-4dfd-b196-d57389eb9a30 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:20.131855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83840-869a-4dfd-b196-d57389eb9a30 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:20.132572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 737/1479] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:44:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:20.141585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98b73-d0cc-4813-9fa2-0c30a29bfe0a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:20.142365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98b73-d0cc-4813-9fa2-0c30a29bfe0a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:20.142640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb98b73-d0cc-4813-9fa2-0c30a29bfe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:20.215039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ddb98b73-d0cc-4813-9fa2-0c30a29bfe0a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:20.216253 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ddb98b73-d0cc-4813-9fa2-0c30a29bfe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:20.327235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 743/1480] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:44:20.617846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f83840-869a-4dfd-b196-d57389eb9a30 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:44:20.619549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-80f83840-869a-4dfd-b196-d57389eb9a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:20.629880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:20.778674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f83840-869a-4dfd-b196-d57389eb9a30 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:44:20.875300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:20.909121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7392bf-46cf-412b-84d0-4d80e1c01b6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:44:20.909738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7392bf-46cf-412b-84d0-4d80e1c01b6b service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:20.910013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7392bf-46cf-412b-84d0-4d80e1c01b6b service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:20.910281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7392bf-46cf-412b-84d0-4d80e1c01b6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:20.911893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fa7392bf-46cf-412b-84d0-4d80e1c01b6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:21.011198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7392bf-46cf-412b-84d0-4d80e1c01b6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:44:21.012805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7392bf-46cf-412b-84d0-4d80e1c01b6b service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:44:21.030946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 738/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:44:23.128870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4486fe-efaa-4ced-bc49-00f77ff86aa0 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:23.129521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4486fe-efaa-4ced-bc49-00f77ff86aa0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:23.129521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4486fe-efaa-4ced-bc49-00f77ff86aa0 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:23.130794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 744/1482] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:23.137289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29470-5d41-4811-884c-5b4bd4a842be None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:23.137994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29470-5d41-4811-884c-5b4bd4a842be None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:23.138109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba29470-5d41-4811-884c-5b4bd4a842be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:23.211202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0ba29470-5d41-4811-884c-5b4bd4a842be None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:23.212703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0ba29470-5d41-4811-884c-5b4bd4a842be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:23.264046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:23.325162 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 739/1483] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:44:23.624040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4486fe-efaa-4ced-bc49-00f77ff86aa0 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:44:23.626570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-da4486fe-efaa-4ced-bc49-00f77ff86aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:23.654675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:23.736232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4486fe-efaa-4ced-bc49-00f77ff86aa0 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:44:23.809869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8d2ee-c72e-44a9-b791-9cbc29c3891f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:44:23.810472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8d2ee-c72e-44a9-b791-9cbc29c3891f service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:23.810722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8d2ee-c72e-44a9-b791-9cbc29c3891f service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:23.810990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8d2ee-c72e-44a9-b791-9cbc29c3891f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:23.812596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fcf8d2ee-c72e-44a9-b791-9cbc29c3891f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:23.891776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:23.928326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8d2ee-c72e-44a9-b791-9cbc29c3891f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:44:23.929829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8d2ee-c72e-44a9-b791-9cbc29c3891f service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:44:23.948882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 745/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:44:25.932326 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002840-00a6-45dc-84ea-65a58810702f None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:25.933234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002840-00a6-45dc-84ea-65a58810702f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:25.933234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b002840-00a6-45dc-84ea-65a58810702f None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:25.935487 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 740/1485] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:25.940897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c068d6-cbeb-4b3b-86a4-895c5114f51d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:25.941377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c068d6-cbeb-4b3b-86a4-895c5114f51d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:25.941484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c068d6-cbeb-4b3b-86a4-895c5114f51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:26.010210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-25c068d6-cbeb-4b3b-86a4-895c5114f51d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:26.011408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-25c068d6-cbeb-4b3b-86a4-895c5114f51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:26.115879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 746/1486] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:44:26.412976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002840-00a6-45dc-84ea-65a58810702f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:44:26.415877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3b002840-00a6-45dc-84ea-65a58810702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:26.531277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b002840-00a6-45dc-84ea-65a58810702f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:44:26.607256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:26.609749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c6fe8-30fe-407b-9a91-c879c25589cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:44:26.610599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6fe8-30fe-407b-9a91-c879c25589cb service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:26.610881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6fe8-30fe-407b-9a91-c879c25589cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:26.611156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c6fe8-30fe-407b-9a91-c879c25589cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:26.613671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d90c6fe8-30fe-407b-9a91-c879c25589cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:26.728337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c6fe8-30fe-407b-9a91-c879c25589cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:44:26.729733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c6fe8-30fe-407b-9a91-c879c25589cb service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:44:26.748442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 741/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:44:28.809460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386d11-5a15-471c-8ba1-e29a031d56fe None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:28.810073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386d11-5a15-471c-8ba1-e29a031d56fe None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:28.810073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e386d11-5a15-471c-8ba1-e29a031d56fe None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:28.811362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 747/1488] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:28.817821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905bd3-3836-435d-bbd5-8284196085ec None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:28.818580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905bd3-3836-435d-bbd5-8284196085ec None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:28.818721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65905bd3-3836-435d-bbd5-8284196085ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:28.889505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-65905bd3-3836-435d-bbd5-8284196085ec None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:28.890717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-65905bd3-3836-435d-bbd5-8284196085ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:28.949659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:28.996136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 742/1489] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:44:29.296602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e386d11-5a15-471c-8ba1-e29a031d56fe None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:44:29.299162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5e386d11-5a15-471c-8ba1-e29a031d56fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:29.342695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:29.418101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e386d11-5a15-471c-8ba1-e29a031d56fe None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:44:29.500497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34aae-5b91-4622-8fd0-48e5d2527640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:44:29.501184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34aae-5b91-4622-8fd0-48e5d2527640 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:29.501466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34aae-5b91-4622-8fd0-48e5d2527640 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:29.501740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34aae-5b91-4622-8fd0-48e5d2527640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:29.503375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-77f34aae-5b91-4622-8fd0-48e5d2527640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:29.587947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:29.618999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34aae-5b91-4622-8fd0-48e5d2527640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:44:29.620455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34aae-5b91-4622-8fd0-48e5d2527640 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:44:29.638451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 748/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:44:31.750617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcd74c-57d1-4bea-8f5e-f8e74958bd4e None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:31.751582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcd74c-57d1-4bea-8f5e-f8e74958bd4e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:31.751582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcd74c-57d1-4bea-8f5e-f8e74958bd4e None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:31.753695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 743/1491] 10.222.0.13 () {54 vars in 927 bytes} [Sat Sep 3 03:44:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:44:31.761315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e757ba5-9188-41f6-91b5-95f3248f6a31 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:31.761735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e757ba5-9188-41f6-91b5-95f3248f6a31 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:31.761844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e757ba5-9188-41f6-91b5-95f3248f6a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:31.837939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0e757ba5-9188-41f6-91b5-95f3248f6a31 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:44:31.839197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0e757ba5-9188-41f6-91b5-95f3248f6a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:31.951101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 749/1492] 10.222.0.13 () {58 vars in 1024 bytes} [Sat Sep 3 03:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:44:32.247414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcd74c-57d1-4bea-8f5e-f8e74958bd4e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:44:32.248971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-33fcd74c-57d1-4bea-8f5e-f8e74958bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:32.362434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcd74c-57d1-4bea-8f5e-f8e74958bd4e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:44:32.447280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0883-1e10-45c4-b595-7b2876a01b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:44:32.447810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0883-1e10-45c4-b595-7b2876a01b36 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:44:32.448093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0883-1e10-45c4-b595-7b2876a01b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:44:32.448381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0883-1e10-45c4-b595-7b2876a01b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:44:32.450016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7ceb0883-1e10-45c4-b595-7b2876a01b36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:44:32.460066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:32.572546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0883-1e10-45c4-b595-7b2876a01b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:44:32.574129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0883-1e10-45c4-b595-7b2876a01b36 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:44:32.594062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 744/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:44:41.949221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=82 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:44:42.591369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=50 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:45.631911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:45.632484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:45.632584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:45.718534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:45:45.719765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:45.829266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 750/1494] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:45:45.842067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dc347-7f49-46ad-b3e3-caaf551e9250 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:45.842593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dc347-7f49-46ad-b3e3-caaf551e9250 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:45.842688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dc347-7f49-46ad-b3e3-caaf551e9250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:45.926898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8a8dc347-7f49-46ad-b3e3-caaf551e9250 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:45:45.928115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8a8dc347-7f49-46ad-b3e3-caaf551e9250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:46.030830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 745/1495] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:45:46.036472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:46.038175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:46.049590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86bd8b-99b0-4ec1-ae8c-c5813d7d9600 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:46.114480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:46.149555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:46.150156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:46.150437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:46.150703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:46.151339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:45:46.151639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:46.152666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:46.152666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:45:46.152666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:45:46.153591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:46.166024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 751/1496] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:45:46.175200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dc347-7f49-46ad-b3e3-caaf551e9250 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:46.185824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dc347-7f49-46ad-b3e3-caaf551e9250 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:46.254138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:46.289929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:46.290539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:46.290815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:46.291084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:46.291705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:46.293492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING py.warnings [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:46.293492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: warnings.warn(msg) Sep 03 03:45:46.293492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: Sep 03 03:45:46.294694 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:46.354014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 746/1497] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:45:46 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:45:46.358936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:46.360489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:46.396232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf523c86-31eb-4b0b-a080-03c583729e85 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:46.513755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:46.514535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:46.514964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:46.515319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:46.516245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:46.517798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:46.517798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:45:46.517798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:45:46.519301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:46.567331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 752/1498] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:45:46 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:45:46.572479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:46.574814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:46.645795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185c03-061a-4572-95e6-9c07490c2dc0 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:46.737566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:46.750477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:46.751093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:46.751371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:46.751643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:46.752283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:46.753332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING py.warnings [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:46.753332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: warnings.warn(msg) Sep 03 03:45:46.753332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: Sep 03 03:45:46.754226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:46.767528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 747/1499] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:45:46.771703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:46.773542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:46.785495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde09cd2-2aa8-436a-bc23-4f42596ceddd admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:46.819876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:46.894714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930c1bc-eadf-4db3-b489-fc7ef8ed60be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:46.895322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930c1bc-eadf-4db3-b489-fc7ef8ed60be admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:46.895603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930c1bc-eadf-4db3-b489-fc7ef8ed60be admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:46.895869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930c1bc-eadf-4db3-b489-fc7ef8ed60be admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:46.896519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930c1bc-eadf-4db3-b489-fc7ef8ed60be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:46.897707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-1930c1bc-eadf-4db3-b489-fc7ef8ed60be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:46.897707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:45:46.897707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:45:46.898602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930c1bc-eadf-4db3-b489-fc7ef8ed60be admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:46.911435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 753/1500] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:45:46.915961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:46.917520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:46.954822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fccc2e-8626-42c4-a487-33ef174755c5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:47.062240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d135ff-e1d4-4d24-b066-72b807a83792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:47.062818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d135ff-e1d4-4d24-b066-72b807a83792 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:47.063093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d135ff-e1d4-4d24-b066-72b807a83792 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:47.063363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d135ff-e1d4-4d24-b066-72b807a83792 admin admin] PATH_INFO: `/v3/projects/b067d45642764261bd5841e582b61be6/users/2e1a2338c57d4a1c90512a71d40deb94/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:47.085893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d135ff-e1d4-4d24-b066-72b807a83792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b067d45642764261bd5841e582b61be6, user_id=2e1a2338c57d4a1c90512a71d40deb94, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:47.086924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING py.warnings [None req-98d135ff-e1d4-4d24-b066-72b807a83792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:47.086924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: warnings.warn(msg) Sep 03 03:45:47.086924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: Sep 03 03:45:47.088870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d135ff-e1d4-4d24-b066-72b807a83792 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:47.117364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 748/1501] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:45:46 2022] PUT /identity/v3/projects/b067d45642764261bd5841e582b61be6/users/2e1a2338c57d4a1c90512a71d40deb94/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:45:47.129907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da919be-f95c-4d84-90e0-a13a877639cc None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:47.130244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da919be-f95c-4d84-90e0-a13a877639cc None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:47.130580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da919be-f95c-4d84-90e0-a13a877639cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:47.201186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0da919be-f95c-4d84-90e0-a13a877639cc None None] MFA Rules not processed for user `2e1a2338c57d4a1c90512a71d40deb94`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:45:47.202405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0da919be-f95c-4d84-90e0-a13a877639cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:47.292258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 754/1502] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:45:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:45:47.306719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7d3f-0a55-445b-b21e-0e1038b8f0a7 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:47.307005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7d3f-0a55-445b-b21e-0e1038b8f0a7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:47.307272 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7d3f-0a55-445b-b21e-0e1038b8f0a7 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:47.308633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 749/1503] 10.222.0.13 () {54 vars in 964 bytes} [Sat Sep 3 03:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:45:47.314379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4954-c8a7-4b5b-8e63-e87788509399 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:47.314626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4954-c8a7-4b5b-8e63-e87788509399 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:47.314932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4954-c8a7-4b5b-8e63-e87788509399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:47.349339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:47.397050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-59cc4954-c8a7-4b5b-8e63-e87788509399 None None] MFA Rules not processed for user `21baacaa1f1c4342aacda4c967a6da58`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:45:47.398352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-59cc4954-c8a7-4b5b-8e63-e87788509399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:47.481506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 755/1504] 10.222.0.13 () {58 vars in 1061 bytes} [Sat Sep 3 03:45:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:45:47.491029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a7d3f-0a55-445b-b21e-0e1038b8f0a7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:47.493069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b35a7d3f-0a55-445b-b21e-0e1038b8f0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:47.551501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:47.608971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a7d3f-0a55-445b-b21e-0e1038b8f0a7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:47.687920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:47.688529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:47.688806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:47.689107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:47.690706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:47.796905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:47.798375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:47.802236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:47.816713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 750/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:45:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:45:47.862683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3377-410c-447e-a104-38ca11958e65 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:47.863138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3377-410c-447e-a104-38ca11958e65 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:47.863138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d3377-410c-447e-a104-38ca11958e65 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:47.864408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 756/1506] 10.222.0.13 () {52 vars in 830 bytes} [Sat Sep 3 03:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:45:47.868073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:47.869313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:47.973905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c21b0e-a0ad-4d3c-9cad-34d6024ff28f service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:48.070875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:48.071818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:48.072231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:48.072620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] PATH_INFO: `/v3/users/2e1a2338c57d4a1c90512a71d40deb94` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:48.091666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1a2338c57d4a1c90512a71d40deb94)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:48.092683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING py.warnings [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:48.092683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: warnings.warn(msg) Sep 03 03:45:48.092683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: Sep 03 03:45:48.093947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:48.105651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:48.174151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1a2338c57d4a1c90512a71d40deb94'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:48.174598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1a2338c57d4a1c90512a71d40deb94'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:48.189126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1a2338c57d4a1c90512a71d40deb94'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:48.200385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1a2338c57d4a1c90512a71d40deb94'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:48.200905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1a2338c57d4a1c90512a71d40deb94'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:48.231459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 751/1507] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:45:47 2022] DELETE /identity/v3/users/2e1a2338c57d4a1c90512a71d40deb94 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:45:48.235996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:48.236285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:48.236560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:48.295935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:45:48.297264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:48.381121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:48.394186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 757/1508] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:45:48.407723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:48.409681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:48.522884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dff2da-609d-4e5a-939a-17335cc1b4e3 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:48.581590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:48.602957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eec2f5-d6f2-421a-a34f-1ef71caa030a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:48.603557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eec2f5-d6f2-421a-a34f-1ef71caa030a service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:48.603839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eec2f5-d6f2-421a-a34f-1ef71caa030a service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:48.604133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eec2f5-d6f2-421a-a34f-1ef71caa030a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:48.605782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-62eec2f5-d6f2-421a-a34f-1ef71caa030a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:48.713644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eec2f5-d6f2-421a-a34f-1ef71caa030a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:48.715114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eec2f5-d6f2-421a-a34f-1ef71caa030a service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:48.733744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 752/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:45:49.132783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:45:49.134149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:45:49.145841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cff05e-8f53-4f39-bb34-160e988f2812 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:45:49.249525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:45:49.250162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:45:49.250436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:45:49.250706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] PATH_INFO: `/v3/projects/b067d45642764261bd5841e582b61be6` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:45:49.260338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b067d45642764261bd5841e582b61be6)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:45:49.261432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:45:49.261432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:45:49.261432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:45:49.262614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:45:49.326676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b067d45642764261bd5841e582b61be6', 'request_id': 'req-71ec020d-ca9f-42f9-bd17-1c528577aea7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:49.337571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b067d45642764261bd5841e582b61be6', 'request_id': 'req-71ec020d-ca9f-42f9-bd17-1c528577aea7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:49.343970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b067d45642764261bd5841e582b61be6', 'request_id': 'req-71ec020d-ca9f-42f9-bd17-1c528577aea7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:49.375190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] The token cache is being invalidate because project b067d45642764261bd5841e582b61be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:45:49.375411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:49.375832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-71ec020d-ca9f-42f9-bd17-1c528577aea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:45:49.377316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 758/1510] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:45:49 2022] DELETE /identity/v3/projects/b067d45642764261bd5841e582b61be6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:45:58.731353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=62 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:45:59.372806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:23.168828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a24ef-d79a-4756-97e8-3d01dbb3f935 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:23.169415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a24ef-d79a-4756-97e8-3d01dbb3f935 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:23.169415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a24ef-d79a-4756-97e8-3d01dbb3f935 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:23.170800 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:23.175941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc423f-5c75-49af-b60d-2337a75a61b7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:23.176469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc423f-5c75-49af-b60d-2337a75a61b7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:23.176567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc423f-5c75-49af-b60d-2337a75a61b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:23.264262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b4bc423f-5c75-49af-b60d-2337a75a61b7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:23.265572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b4bc423f-5c75-49af-b60d-2337a75a61b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:23.377707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:23.536770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a24ef-d79a-4756-97e8-3d01dbb3f935 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:23.539362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-595a24ef-d79a-4756-97e8-3d01dbb3f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:23.670826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a24ef-d79a-4756-97e8-3d01dbb3f935 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:23.676492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475e9e-e88e-4ef3-af06-e56492b54543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:23.677141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475e9e-e88e-4ef3-af06-e56492b54543 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:23.677429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475e9e-e88e-4ef3-af06-e56492b54543 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:23.677704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475e9e-e88e-4ef3-af06-e56492b54543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:23.685956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475e9e-e88e-4ef3-af06-e56492b54543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:23.687539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475e9e-e88e-4ef3-af06-e56492b54543 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:23.697673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 754/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:24.547149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed9d47-3d94-4586-9037-0461c98f8571 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:24.547700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed9d47-3d94-4586-9037-0461c98f8571 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:24.547700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed9d47-3d94-4586-9037-0461c98f8571 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:24.549183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:24.554105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584ec56-10bc-47be-bdcd-9f670bc03b80 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:24.554578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584ec56-10bc-47be-bdcd-9f670bc03b80 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:24.554680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584ec56-10bc-47be-bdcd-9f670bc03b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:24.575288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6584ec56-10bc-47be-bdcd-9f670bc03b80 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:24.576473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6584ec56-10bc-47be-bdcd-9f670bc03b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:24.585081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:24.738438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed9d47-3d94-4586-9037-0461c98f8571 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:24.755699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed9d47-3d94-4586-9037-0461c98f8571 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:24.761781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd55f-6b38-45df-aed7-08a7ad8a7df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:24.762384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd55f-6b38-45df-aed7-08a7ad8a7df6 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:24.762668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd55f-6b38-45df-aed7-08a7ad8a7df6 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:24.762946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd55f-6b38-45df-aed7-08a7ad8a7df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:24.772384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd55f-6b38-45df-aed7-08a7ad8a7df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:24.774057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfd55f-6b38-45df-aed7-08a7ad8a7df6 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:24.783985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 761/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:25.672735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399a97-38d0-496d-9a78-3eaec55bb1bd None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:25.673393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399a97-38d0-496d-9a78-3eaec55bb1bd None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:25.673393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399a97-38d0-496d-9a78-3eaec55bb1bd None None] PATH_INFO: `/v3` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:25.674624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 756/1517] 10.222.0.42 () {54 vars in 925 bytes} [Sat Sep 3 03:47:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:47:25.681154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77dfde-96e8-40ac-b1d0-3e9845209d31 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:25.681614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77dfde-96e8-40ac-b1d0-3e9845209d31 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:25.681785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77dfde-96e8-40ac-b1d0-3e9845209d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:25.756284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8c77dfde-96e8-40ac-b1d0-3e9845209d31 None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:25.757521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8c77dfde-96e8-40ac-b1d0-3e9845209d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:25.776841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:25.835711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 762/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Sep 3 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:29.844038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de1c24-f1da-4615-9b31-db4e79293510 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:29.844830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de1c24-f1da-4615-9b31-db4e79293510 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:29.844830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de1c24-f1da-4615-9b31-db4e79293510 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:29.846732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 757/1519] 10.222.0.13 () {54 vars in 961 bytes} [Sat Sep 3 03:47:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:29.852568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabcdda-4bee-40b8-9b60-e9d7a04b9162 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:29.853066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabcdda-4bee-40b8-9b60-e9d7a04b9162 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:29.853180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabcdda-4bee-40b8-9b60-e9d7a04b9162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:29.880058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7eabcdda-4bee-40b8-9b60-e9d7a04b9162 None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:29.881364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7eabcdda-4bee-40b8-9b60-e9d7a04b9162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:29.895992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 763/1520] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Sep 3 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:29.907628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de1c24-f1da-4615-9b31-db4e79293510 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:29.923616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de1c24-f1da-4615-9b31-db4e79293510 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:29.929465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f075d6-84b0-4209-ace8-b3dfc3159914 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:29.930062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f075d6-84b0-4209-ace8-b3dfc3159914 service placement] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:29.930342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f075d6-84b0-4209-ace8-b3dfc3159914 service placement] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:29.930598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f075d6-84b0-4209-ace8-b3dfc3159914 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:29.939004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f075d6-84b0-4209-ace8-b3dfc3159914 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:29.940581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f075d6-84b0-4209-ace8-b3dfc3159914 service placement] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:29.950310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 758/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:36.039859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4f02-15cb-4701-ac09-18b88d2ad47b None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:36.040416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4f02-15cb-4701-ac09-18b88d2ad47b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:36.040416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4f02-15cb-4701-ac09-18b88d2ad47b None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:36.041716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:36.047080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e15b1-32d4-4027-ba8e-05dff950b217 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:36.047510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e15b1-32d4-4027-ba8e-05dff950b217 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:36.047633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e15b1-32d4-4027-ba8e-05dff950b217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:36.069803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4f8e15b1-32d4-4027-ba8e-05dff950b217 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:36.071011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4f8e15b1-32d4-4027-ba8e-05dff950b217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:36.079595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:36.235385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f4f02-15cb-4701-ac09-18b88d2ad47b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:36.253422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f4f02-15cb-4701-ac09-18b88d2ad47b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:36.259543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e64d12-2a16-4217-a88a-eba60cdac323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:36.260156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e64d12-2a16-4217-a88a-eba60cdac323 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:36.260437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e64d12-2a16-4217-a88a-eba60cdac323 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:36.260710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e64d12-2a16-4217-a88a-eba60cdac323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:36.269203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e64d12-2a16-4217-a88a-eba60cdac323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:36.270885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e64d12-2a16-4217-a88a-eba60cdac323 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:36.280462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 765/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:37.115413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e627-0b09-4a28-9eba-fb0d6dbbb975 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:37.116062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e627-0b09-4a28-9eba-fb0d6dbbb975 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:37.116062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e627-0b09-4a28-9eba-fb0d6dbbb975 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:37.117289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 03:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:37.123218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8432c5b-cbab-4b75-9730-04c3fb836ca6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:37.123990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8432c5b-cbab-4b75-9730-04c3fb836ca6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:37.124145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8432c5b-cbab-4b75-9730-04c3fb836ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:37.271605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a8432c5b-cbab-4b75-9730-04c3fb836ca6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:37.273290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a8432c5b-cbab-4b75-9730-04c3fb836ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:37.282645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 03:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:37.434257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19e627-0b09-4a28-9eba-fb0d6dbbb975 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:37.451135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19e627-0b09-4a28-9eba-fb0d6dbbb975 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:37.458015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191c111-a5ca-421b-b1d2-263952ce46ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:37.458700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c111-a5ca-421b-b1d2-263952ce46ba service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:37.458976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c111-a5ca-421b-b1d2-263952ce46ba service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:37.459242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191c111-a5ca-421b-b1d2-263952ce46ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:37.468347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191c111-a5ca-421b-b1d2-263952ce46ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:37.469956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191c111-a5ca-421b-b1d2-263952ce46ba service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:37.480700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 761/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:41.528271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d1d2-cafa-4cc9-a1a6-b9301d6b2dbf None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:41.529225 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d1d2-cafa-4cc9-a1a6-b9301d6b2dbf None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:41.529225 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d1d2-cafa-4cc9-a1a6-b9301d6b2dbf None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:41.531203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:47:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:41.539477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269cc78-cd2b-4688-8a2f-1ed5b58ee4e6 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:41.539941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269cc78-cd2b-4688-8a2f-1ed5b58ee4e6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:41.540066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269cc78-cd2b-4688-8a2f-1ed5b58ee4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:41.561260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1269cc78-cd2b-4688-8a2f-1ed5b58ee4e6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:41.562483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1269cc78-cd2b-4688-8a2f-1ed5b58ee4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:41.571406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:47:41.859350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2d1d2-cafa-4cc9-a1a6-b9301d6b2dbf None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:41.862502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-69b2d1d2-cafa-4cc9-a1a6-b9301d6b2dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:41.949133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2d1d2-cafa-4cc9-a1a6-b9301d6b2dbf None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:41.953386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f45810-beca-4348-923a-7c54908da7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:41.954005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45810-beca-4348-923a-7c54908da7ea service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:41.954282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45810-beca-4348-923a-7c54908da7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:41.954556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45810-beca-4348-923a-7c54908da7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:41.963996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f45810-beca-4348-923a-7c54908da7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:41.965477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f45810-beca-4348-923a-7c54908da7ea service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:41.975026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 768/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:43.877469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d13f-17e0-49e2-8387-f850efc311b7 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:43.878461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d13f-17e0-49e2-8387-f850efc311b7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:43.878461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d13f-17e0-49e2-8387-f850efc311b7 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:43.880518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:47:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:43.887519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34743003-2582-4adb-9c37-189dd52a6bf8 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:43.888023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34743003-2582-4adb-9c37-189dd52a6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:43.888133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34743003-2582-4adb-9c37-189dd52a6bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:43.915016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-34743003-2582-4adb-9c37-189dd52a6bf8 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:43.916696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-34743003-2582-4adb-9c37-189dd52a6bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:43.927806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:44.224281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d13f-17e0-49e2-8387-f850efc311b7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:44.243111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d13f-17e0-49e2-8387-f850efc311b7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:44.247006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f02c2-a786-44bf-8642-6939a0a0289a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:44.247609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f02c2-a786-44bf-8642-6939a0a0289a service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:44.247886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f02c2-a786-44bf-8642-6939a0a0289a service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:44.248139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f02c2-a786-44bf-8642-6939a0a0289a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:44.258253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f02c2-a786-44bf-8642-6939a0a0289a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:44.259686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f02c2-a786-44bf-8642-6939a0a0289a service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:44.269156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 764/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:47.628474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316807-a2d9-42b9-8a1c-7ecf37c98a5f None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:47.629367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316807-a2d9-42b9-8a1c-7ecf37c98a5f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:47.629367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f316807-a2d9-42b9-8a1c-7ecf37c98a5f None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:47.631274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:47:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:47.636693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320ebe-f967-47a5-a347-7aca5737613d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:47.637185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320ebe-f967-47a5-a347-7aca5737613d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:47.637287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07320ebe-f967-47a5-a347-7aca5737613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:47.657445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-07320ebe-f967-47a5-a347-7aca5737613d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:47.658691 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-07320ebe-f967-47a5-a347-7aca5737613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:47.667177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:48.209691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316807-a2d9-42b9-8a1c-7ecf37c98a5f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:48.213751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6f316807-a2d9-42b9-8a1c-7ecf37c98a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:48.288984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:48.303578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f316807-a2d9-42b9-8a1c-7ecf37c98a5f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:48.307619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf82156-b431-4aec-9470-f09258e7db5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:48.308153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82156-b431-4aec-9470-f09258e7db5d service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:48.308429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82156-b431-4aec-9470-f09258e7db5d service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:48.308695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82156-b431-4aec-9470-f09258e7db5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:48.317996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf82156-b431-4aec-9470-f09258e7db5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:48.319549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf82156-b431-4aec-9470-f09258e7db5d service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:48.328909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 771/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:47:50.209877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d3289-534b-42f6-993e-41a0e71f9c15 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:50.210440 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d3289-534b-42f6-993e-41a0e71f9c15 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:50.210440 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d3289-534b-42f6-993e-41a0e71f9c15 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:50.211793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 03:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:47:50.218116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a40e6d-7020-42da-a207-0268539d8c75 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:50.218832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a40e6d-7020-42da-a207-0268539d8c75 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:50.218981 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a40e6d-7020-42da-a207-0268539d8c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:50.249871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-80a40e6d-7020-42da-a207-0268539d8c75 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:47:50.251077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-80a40e6d-7020-42da-a207-0268539d8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:50.260030 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 03:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:47:50.824983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d3289-534b-42f6-993e-41a0e71f9c15 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:47:50.827833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f76d3289-534b-42f6-993e-41a0e71f9c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:47:50.838834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=84 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:47:50.845521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d3289-534b-42f6-993e-41a0e71f9c15 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:47:50.849582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac03f4b-dde9-4a1c-a423-fea1d05419f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:47:50.850182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03f4b-dde9-4a1c-a423-fea1d05419f7 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:47:50.850609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03f4b-dde9-4a1c-a423-fea1d05419f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:47:50.851085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac03f4b-dde9-4a1c-a423-fea1d05419f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:47:50.860386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac03f4b-dde9-4a1c-a423-fea1d05419f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:47:50.861843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac03f4b-dde9-4a1c-a423-fea1d05419f7 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:47:50.871632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 767/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:48:00.244730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=11 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:48:00.867549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:20.997003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fd947-18e7-42ab-a2bc-3efd47f0a831 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.001179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fd947-18e7-42ab-a2bc-3efd47f0a831 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.001789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fd947-18e7-42ab-a2bc-3efd47f0a831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.027235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0a5fd947-18e7-42ab-a2bc-3efd47f0a831 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.033133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0a5fd947-18e7-42ab-a2bc-3efd47f0a831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.039572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 773/1540] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.048437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84291-4686-4307-a695-94931633295e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.049436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84291-4686-4307-a695-94931633295e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.049990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d84291-4686-4307-a695-94931633295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.081980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c7d84291-4686-4307-a695-94931633295e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.083667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c7d84291-4686-4307-a695-94931633295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.097193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 768/1541] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.106884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fd947-18e7-42ab-a2bc-3efd47f0a831 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.120946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fd947-18e7-42ab-a2bc-3efd47f0a831 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.130244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.131064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.132116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.132116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.132314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.132590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.134340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.156972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 774/1542] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.158254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e984fa-8aff-4deb-bafa-215060fee0cd None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.159370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e984fa-8aff-4deb-bafa-215060fee0cd None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.159903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e984fa-8aff-4deb-bafa-215060fee0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.171899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.192484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa10d0f-0e70-4c63-b509-8b3f3327b500 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.207008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-05e984fa-8aff-4deb-bafa-215060fee0cd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.210773 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-05e984fa-8aff-4deb-bafa-215060fee0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.217900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76243753-552d-4685-9266-6b9923606cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.218549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243753-552d-4685-9266-6b9923606cda admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.218833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243753-552d-4685-9266-6b9923606cda admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.219111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76243753-552d-4685-9266-6b9923606cda admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.219844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243753-552d-4685-9266-6b9923606cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.222630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-76243753-552d-4685-9266-6b9923606cda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:49:21.222630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:49:21.222630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:49:21.223858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76243753-552d-4685-9266-6b9923606cda admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.251355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 769/1543] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 03 03:49:21.260593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea558-c794-4c39-94cb-3508de647523 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.260956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea558-c794-4c39-94cb-3508de647523 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.261175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cea558-c794-4c39-94cb-3508de647523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.302309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-10cea558-c794-4c39-94cb-3508de647523 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.304045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-10cea558-c794-4c39-94cb-3508de647523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.324716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 775/1544] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:49:21.326763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d356-c7c4-4fe3-bad8-ead4eca29195 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.328424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 770/1545] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:49:21.329097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d356-c7c4-4fe3-bad8-ead4eca29195 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.329456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d356-c7c4-4fe3-bad8-ead4eca29195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.331871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cea558-c794-4c39-94cb-3508de647523 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.347254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cea558-c794-4c39-94cb-3508de647523 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.378372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c779d356-c7c4-4fe3-bad8-ead4eca29195 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.384186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c779d356-c7c4-4fe3-bad8-ead4eca29195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.487229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693cd03-0546-42e1-9e3f-4b5138adeb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.487866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693cd03-0546-42e1-9e3f-4b5138adeb69 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.489586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693cd03-0546-42e1-9e3f-4b5138adeb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.489871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693cd03-0546-42e1-9e3f-4b5138adeb69 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.490948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693cd03-0546-42e1-9e3f-4b5138adeb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.493072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING py.warnings [None req-c693cd03-0546-42e1-9e3f-4b5138adeb69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:49:21.493072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: warnings.warn(msg) Sep 03 03:49:21.493072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: Sep 03 03:49:21.495275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693cd03-0546-42e1-9e3f-4b5138adeb69 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.511064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 776/1546] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.512469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779d356-c7c4-4fe3-bad8-ead4eca29195 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.526326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779d356-c7c4-4fe3-bad8-ead4eca29195 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.530207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 771/1547] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:21.531170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547b007-184d-491f-9643-0fad6aa784ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.531598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16325-614c-43de-8a14-3f09a391613d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.531927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b007-184d-491f-9643-0fad6aa784ba admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.532044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16325-614c-43de-8a14-3f09a391613d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.532399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b007-184d-491f-9643-0fad6aa784ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.532525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16325-614c-43de-8a14-3f09a391613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.532810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b007-184d-491f-9643-0fad6aa784ba admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.533913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547b007-184d-491f-9643-0fad6aa784ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.534227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547b007-184d-491f-9643-0fad6aa784ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.535893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547b007-184d-491f-9643-0fad6aa784ba admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.548947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 777/1548] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.550350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751416-ac0c-4b7b-a523-26cdc10df7fb None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.550639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751416-ac0c-4b7b-a523-26cdc10df7fb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.550917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be751416-ac0c-4b7b-a523-26cdc10df7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.552366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-70e16325-614c-43de-8a14-3f09a391613d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.553660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-70e16325-614c-43de-8a14-3f09a391613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.561617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 772/1549] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.562884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4069ba-ce44-459e-930b-725d39e66bc4 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.563463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4069ba-ce44-459e-930b-725d39e66bc4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.563807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4069ba-ce44-459e-930b-725d39e66bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.571725 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-be751416-ac0c-4b7b-a523-26cdc10df7fb None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.572955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-be751416-ac0c-4b7b-a523-26cdc10df7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.581304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 778/1550] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.582643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf16e9-c163-4ce5-bdee-94178c251028 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.583000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf16e9-c163-4ce5-bdee-94178c251028 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.583369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf16e9-c163-4ce5-bdee-94178c251028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.584249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ac4069ba-ce44-459e-930b-725d39e66bc4 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.585874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ac4069ba-ce44-459e-930b-725d39e66bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.601520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 773/1551] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.601520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200974-a05d-448b-980d-66b8f8fc3a86 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.601520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200974-a05d-448b-980d-66b8f8fc3a86 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.601520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200974-a05d-448b-980d-66b8f8fc3a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.605442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d0cf16e9-c163-4ce5-bdee-94178c251028 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.606641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d0cf16e9-c163-4ce5-bdee-94178c251028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.614711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 779/1552] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.615917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76bff-4e4d-4e73-8f28-70ac05d16e0f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.616247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76bff-4e4d-4e73-8f28-70ac05d16e0f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.616526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c76bff-4e4d-4e73-8f28-70ac05d16e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.620362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a8200974-a05d-448b-980d-66b8f8fc3a86 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.621638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a8200974-a05d-448b-980d-66b8f8fc3a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.629864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 774/1553] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.630513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200974-a05d-448b-980d-66b8f8fc3a86 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.639399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b6c76bff-4e4d-4e73-8f28-70ac05d16e0f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.639558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200974-a05d-448b-980d-66b8f8fc3a86 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.640636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b6c76bff-4e4d-4e73-8f28-70ac05d16e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.644287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f42ca-d56b-4c9c-aabd-efab66d013e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.644869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f42ca-d56b-4c9c-aabd-efab66d013e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.645176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f42ca-d56b-4c9c-aabd-efab66d013e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.645449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f42ca-d56b-4c9c-aabd-efab66d013e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.646081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f42ca-d56b-4c9c-aabd-efab66d013e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.647674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f42ca-d56b-4c9c-aabd-efab66d013e5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.648647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 780/1554] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.649276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76bff-4e4d-4e73-8f28-70ac05d16e0f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.660773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c76bff-4e4d-4e73-8f28-70ac05d16e0f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.663034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 775/1555] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:21.664406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4f87-c4de-4602-a882-e4f3443586cd None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.664688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4f87-c4de-4602-a882-e4f3443586cd None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.664975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4f87-c4de-4602-a882-e4f3443586cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.667534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9221010-2969-4429-932e-e5782ce4a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.668149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221010-2969-4429-932e-e5782ce4a1ac admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.668426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221010-2969-4429-932e-e5782ce4a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.668694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221010-2969-4429-932e-e5782ce4a1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.669404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9221010-2969-4429-932e-e5782ce4a1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.671374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9221010-2969-4429-932e-e5782ce4a1ac admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.684352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ee7a4f87-c4de-4602-a882-e4f3443586cd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.685573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ee7a4f87-c4de-4602-a882-e4f3443586cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.694311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 776/1556] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.696089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502020-e420-4056-b2fa-f32e8ef3b9e8 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.696594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502020-e420-4056-b2fa-f32e8ef3b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.697007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2502020-e420-4056-b2fa-f32e8ef3b9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.706518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 781/1557] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:21.706518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d84b-dc04-44e0-9cf7-8824c58a4bf2 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.706518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d84b-dc04-44e0-9cf7-8824c58a4bf2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.706518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d84b-dc04-44e0-9cf7-8824c58a4bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.716548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d2502020-e420-4056-b2fa-f32e8ef3b9e8 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.717766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d2502020-e420-4056-b2fa-f32e8ef3b9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.726711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0fb4d84b-dc04-44e0-9cf7-8824c58a4bf2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.727869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0fb4d84b-dc04-44e0-9cf7-8824c58a4bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.775121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 777/1558] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.775609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:21.776365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e581e15-f85a-461a-b48e-68ae87eb87ce None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.776634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e581e15-f85a-461a-b48e-68ae87eb87ce None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.777200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e581e15-f85a-461a-b48e-68ae87eb87ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.792400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 782/1559] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.793635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4d84b-dc04-44e0-9cf7-8824c58a4bf2 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.797391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4e581e15-f85a-461a-b48e-68ae87eb87ce None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.798652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4e581e15-f85a-461a-b48e-68ae87eb87ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.802784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4d84b-dc04-44e0-9cf7-8824c58a4bf2 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.806554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 778/1560] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.807780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391cdb-5e52-457d-9601-a01530691075 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.808064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391cdb-5e52-457d-9601-a01530691075 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.808334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391cdb-5e52-457d-9601-a01530691075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.810751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.811351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.811631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.811902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.812545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.812845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.814663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.827357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1c391cdb-5e52-457d-9601-a01530691075 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:21.827727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 783/1561] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.835029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.835179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1c391cdb-5e52-457d-9601-a01530691075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:21.841820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 779/1562] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:21.842672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391cdb-5e52-457d-9601-a01530691075 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.848122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493876e-9f19-4895-a419-82f4d7f921de admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.852239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c391cdb-5e52-457d-9601-a01530691075 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.853243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.854142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.854446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.854716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.855353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.857037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.857178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.857677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.857939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.858196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.858844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.859143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.860342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING py.warnings [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:49:21.860342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: warnings.warn(msg) Sep 03 03:49:21.860342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: Sep 03 03:49:21.861247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.868262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 784/1563] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:21.869091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.881816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 780/1564] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.881816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.882101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feabb3-5dbe-4e23-bc31-dcde40611631 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.884086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.884697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.885011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.885203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24405fda-e641-404e-88d5-5b47a2d19402 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.885321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.885961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.888036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.889682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.890264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.890546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.890813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.891673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.891950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.893551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.895104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:21.915051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 781/1565] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.915051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.915350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 785/1566] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:21.915350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.924830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12faad7-8cf6-4eed-832b-dee6e30ac844 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.925197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575f590-1f2d-426c-b045-c8064e06391e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.929571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.929869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.930163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.930440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.930549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.930707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.930818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.930998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.931348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.931638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.931731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.931946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.933276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.933578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.945374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 782/1567] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.951340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 786/1568] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.951495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.951582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.961772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467d6c3-de83-40ab-aec6-a06b859565e7 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.962163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4de0e2-c463-4482-b8f6-78b1bb21d5a7 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.966379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.966627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:21.966977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.967216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:21.967319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.967510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.967617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:21.967865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:21.968148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:21.968485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.968580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:21.970207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.970478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:21.982358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 787/1569] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:21.983319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:21.994582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7616-76e3-4ee6-a7d8-5521385c5e86 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:21.999482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.000183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.000434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.000727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] PATH_INFO: `/v3/projects/0553b255ab8541f6b30337b5f7b75ccc/users/e41cfa8ce3a847738325ef2952b41e90/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.006056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 783/1570] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:21 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.007044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.015405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0553b255ab8541f6b30337b5f7b75ccc, user_id=e41cfa8ce3a847738325ef2952b41e90, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.016608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:49:22.016608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:49:22.016608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:49:22.018595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.032309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 788/1571] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:21 2022] PUT /identity/v3/projects/0553b255ab8541f6b30337b5f7b75ccc/users/e41cfa8ce3a847738325ef2952b41e90/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:22.033209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.073310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039488-e847-4f48-8374-abd7acaad315 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.092557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50880e-1ec7-4285-9030-91fb63375c1f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.097456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.098062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.098342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.098613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.099234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.100840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.110879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 789/1572] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.111651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.123067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e6e3e-ccc4-43e9-a2db-53ee9ab96cf3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.127919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.128501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.128784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.129089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.129302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.129796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.129908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.130132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.130408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.131037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.131677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.132946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.160272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 790/1573] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.161213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 784/1574] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.161959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.162102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.208226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:22.216607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:22.229159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497295ab-4f4d-48ca-a688-d7e21d70040e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.231719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bda7d-a27e-4392-8d4c-3d31984f414c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.233929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.234546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.234887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.235161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.235796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.237068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.237678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.237793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.237955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.238223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.238847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.240796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.269291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 785/1575] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.269291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.271998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 791/1576] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.272975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.331143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9295a99-2bbb-4af3-a9e4-35a02288546e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.335884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.336500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.336785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.337100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.337739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.338402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074207-4635-4e9f-a1b5-50de69e20feb admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.339695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.343615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356b0f5-8ec0-4177-8fe4-32fab3c00d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.344281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b0f5-8ec0-4177-8fe4-32fab3c00d9d admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.344589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b0f5-8ec0-4177-8fe4-32fab3c00d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.344825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356b0f5-8ec0-4177-8fe4-32fab3c00d9d admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.345525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b0f5-8ec0-4177-8fe4-32fab3c00d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.347430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356b0f5-8ec0-4177-8fe4-32fab3c00d9d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.370550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 792/1577] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.374928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 786/1578] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.375093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b88757-0117-4d55-8e9c-5fcd75512fb4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.375093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b88757-0117-4d55-8e9c-5fcd75512fb4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.375093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b88757-0117-4d55-8e9c-5fcd75512fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.375397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.392261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f3b88757-0117-4d55-8e9c-5fcd75512fb4 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:22.393536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f3b88757-0117-4d55-8e9c-5fcd75512fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:22.441665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cb25e-174d-4f56-b2f1-53c0d17c8a48 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.447554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.448209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.448461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.448755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.449420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.451131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.455683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 793/1579] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:22.456564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b88757-0117-4d55-8e9c-5fcd75512fb4 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.465941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 787/1580] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.466094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b88757-0117-4d55-8e9c-5fcd75512fb4 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.467244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.471353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.471949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.472231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.472505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.473177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.475117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.477946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2eb3-adc5-41ae-86de-66947d320602 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.483039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.483631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.483994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.484274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.484947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.486888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.497320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 794/1581] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.498295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.509010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6175aa-1f34-4e03-8dee-3cf8a34b0d73 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.516204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 788/1582] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/users => generated 303 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.516364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.516484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.516578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.516578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.516578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.516578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.517964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.523775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6938c1f-b64e-4da2-9ab3-47e6580b20bf admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.528689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.529314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.529650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.529840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.530491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.532505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.541314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 795/1583] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.542353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.553159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32dec-a3c5-4f3e-912c-d15298720c8e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.556046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 789/1584] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.557025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.559135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.559500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.559777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.560047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.560687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.562323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.569038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e542c-d675-426c-9ea2-41ee3004885a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.573852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.574155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 796/1585] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.574449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.574733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.574991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.575092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.575621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.577615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.584473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:22.604772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 790/1586] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:22.604772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.611135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:22.615860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532c671-f2ec-48b8-9b85-8bf9b02bb247 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.622485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.623137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.623480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.623760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] PATH_INFO: `/v3/projects/cf8ed29fbfe24550a6350b98ea0a9a40/users/44a51adff4c546da9c7f476e58e2fc88/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.633555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf151d0e-88ab-4f8e-b468-bcf1e30a43f8 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.637728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.638340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.638442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8ed29fbfe24550a6350b98ea0a9a40, user_id=44a51adff4c546da9c7f476e58e2fc88, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.638622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.638913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.641265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.648867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.650513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.654968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 791/1587] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:22 2022] PUT /identity/v3/projects/cf8ed29fbfe24550a6350b98ea0a9a40/users/44a51adff4c546da9c7f476e58e2fc88/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:22.655819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.664664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 797/1588] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:22.665599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.675991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddaa60-9c62-4ddc-bd31-3a2a0808e65c service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.732841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330045cf-4f32-402a-a873-9da82db3130f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.738320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.739310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.739514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.739786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.740429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.742061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.745787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.747408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.747796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.748170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.748990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.750920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.752571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 792/1589] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.756346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.764221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 798/1590] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.765152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.766535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f3b7-31c1-413d-b2b4-ba5640f6366c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.771271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.771876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.772155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.772428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.773103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.774709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.778874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052630c-2296-4fa6-99ff-d642bcdbab15 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.784529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.785548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.786091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.786580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.787444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.789631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.789861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 793/1591] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.790916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.803051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab91b2-6750-4ab5-a8cc-44ddf07bbc1d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.808099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d04cd2-67b8-4cb4-b035-a1f5822ea2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.811604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04cd2-67b8-4cb4-b035-a1f5822ea2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.811604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04cd2-67b8-4cb4-b035-a1f5822ea2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.811604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d04cd2-67b8-4cb4-b035-a1f5822ea2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.811604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d04cd2-67b8-4cb4-b035-a1f5822ea2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.811962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d04cd2-67b8-4cb4-b035-a1f5822ea2b2 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.812804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 799/1592] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.814323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.824436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 794/1593] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.825562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87f57e-d826-4329-9904-bb983e6843b1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.826029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444aed4-6f2d-4c76-853e-00fb6f22330c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.826366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444aed4-6f2d-4c76-853e-00fb6f22330c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.826640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444aed4-6f2d-4c76-853e-00fb6f22330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.831698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.832469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.832749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.833132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.833794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.836140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.848722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1444aed4-6f2d-4c76-853e-00fb6f22330c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:22.850138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1444aed4-6f2d-4c76-853e-00fb6f22330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:22.853631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 800/1594] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.855118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.865235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 795/1595] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:22.866147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444aed4-6f2d-4c76-853e-00fb6f22330c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.867293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295554eb-31b5-4ad9-a7b7-8b640cdf6efc admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.872724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.873677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.873677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.873885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.874536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.876199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.877674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444aed4-6f2d-4c76-853e-00fb6f22330c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.883344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.884164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.884668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.885307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.886127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.887769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.902782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 801/1596] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.903920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.906161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 796/1597] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.907522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.917621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae203ac-a66b-410b-9648-94bc6a6bc609 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.918914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5cfec-db67-4c7f-8d38-6dfc350b346d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.923298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.923700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.923953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.924184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.924306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.924457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.924572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.924833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.925136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.925593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.926758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.927309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.938265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 802/1598] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.939050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.942647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 797/1599] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.943554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.950853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8dcd2-0c8f-4446-9c1c-eceda7cf7f9c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.953437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d4225-56cb-4e76-b051-deab24dceeee admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:22.956508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.957225 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.957503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.957783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] PATH_INFO: `/v3/projects/ee7ec7906b3a4e8f81b975b95df1a1e4/users/0845ac8c41aa47109ed5fa8375182c35/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.958930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:22.959605 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:22.959956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:22.960315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:22.961108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.962778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.974296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7ec7906b3a4e8f81b975b95df1a1e4, user_id=0845ac8c41aa47109ed5fa8375182c35, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:22.980222 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 798/1600] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:22.980377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:22.980498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:22.982971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:22.995174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 803/1601] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:22 2022] PUT /identity/v3/projects/ee7ec7906b3a4e8f81b975b95df1a1e4/users/0845ac8c41aa47109ed5fa8375182c35/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:22.995993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:23.049946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:23.064960 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd53f02-1454-4daf-a297-28ab857f1b05 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:23.081660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ae28-c83d-49cb-80f0-acb750424da8 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:23.087191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:23.087924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.088272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.088612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] PATH_INFO: `/v3/projects/cf73661dc0e2415385485014aa8dc32b/users/3380e12364ed4427830962d76df23a5d/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.095789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:23.109569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf73661dc0e2415385485014aa8dc32b, user_id=3380e12364ed4427830962d76df23a5d, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:23.110659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:23.125647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:23.126582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.126959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.127343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.130113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 804/1602] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:22 2022] PUT /identity/v3/projects/cf73661dc0e2415385485014aa8dc32b/users/3380e12364ed4427830962d76df23a5d/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:23.131264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:23.153440 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:23.155058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:23.168127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 799/1603] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:23.169165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:23.181119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebe538-bbec-4017-a91b-e40ae78a4754 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:23.250208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d5199-c7f2-4010-b269-ae420278850a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:23.255636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:23.256377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.256678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.257009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] PATH_INFO: `/v3/projects/b399dec697094d91abb0ae9409d21a62/users/a1b5c7459d4a4833b94cb6e79c80ca71/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.259392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:23.260311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.260743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.261234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] PATH_INFO: `/v3/projects/d6e5bb1a3f06498faeafe051fd853ef3/users/8f581ef77233477cbfdb987c3b2508ac/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.274113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b399dec697094d91abb0ae9409d21a62, user_id=a1b5c7459d4a4833b94cb6e79c80ca71, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:23.277304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:23.281772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e5bb1a3f06498faeafe051fd853ef3, user_id=8f581ef77233477cbfdb987c3b2508ac, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:23.284983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:23.293999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 805/1604] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:23 2022] PUT /identity/v3/projects/b399dec697094d91abb0ae9409d21a62/users/a1b5c7459d4a4833b94cb6e79c80ca71/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:23.295051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:23.311491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 800/1605] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:23 2022] PUT /identity/v3/projects/d6e5bb1a3f06498faeafe051fd853ef3/users/8f581ef77233477cbfdb987c3b2508ac/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:23.316952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:23.374247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067418a-66c4-4e6b-9692-9d2a5f9c7a4c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:23.397959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c780d-06e9-4b2a-a3a6-8f133e404d49 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:23.408641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0a09f-a607-4288-9d52-a2e0229156ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:23.409699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0a09f-a607-4288-9d52-a2e0229156ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.410035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0a09f-a607-4288-9d52-a2e0229156ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.410321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0a09f-a607-4288-9d52-a2e0229156ea admin admin] PATH_INFO: `/v3/projects/d557c51c39144a43b93ef656a967b16e/users/1a3d08bbd8aa4338b905ac912d1319fc/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.429934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0a09f-a607-4288-9d52-a2e0229156ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d557c51c39144a43b93ef656a967b16e, user_id=1a3d08bbd8aa4338b905ac912d1319fc, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:23.432842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0a09f-a607-4288-9d52-a2e0229156ea admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:23.445815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:23.452533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 801/1606] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:23 2022] PUT /identity/v3/projects/d557c51c39144a43b93ef656a967b16e/users/1a3d08bbd8aa4338b905ac912d1319fc/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:23.454396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8021-6289-49b5-ab1d-8ed039964856 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.454835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8021-6289-49b5-ab1d-8ed039964856 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.455133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa8021-6289-49b5-ab1d-8ed039964856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.459583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636c14d-995f-4093-8805-186bf6a85fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:23.460288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636c14d-995f-4093-8805-186bf6a85fea admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.460571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636c14d-995f-4093-8805-186bf6a85fea admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.461014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636c14d-995f-4093-8805-186bf6a85fea admin admin] PATH_INFO: `/v3/projects/224826ad62114cb4a7f1a328ada88f4e/users/8e91c9887e494f94b275f4b6d293942d/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.478629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636c14d-995f-4093-8805-186bf6a85fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=224826ad62114cb4a7f1a328ada88f4e, user_id=8e91c9887e494f94b275f4b6d293942d, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:23.482172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636c14d-995f-4093-8805-186bf6a85fea admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:23.489033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-14aa8021-6289-49b5-ab1d-8ed039964856 None None] MFA Rules not processed for user `0845ac8c41aa47109ed5fa8375182c35`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:23.490562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-14aa8021-6289-49b5-ab1d-8ed039964856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:23.501445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 806/1607] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:23 2022] PUT /identity/v3/projects/224826ad62114cb4a7f1a328ada88f4e/users/8e91c9887e494f94b275f4b6d293942d/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:23.504199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541138-e0c2-4f4f-b498-5eb3b26ad335 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.504907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541138-e0c2-4f4f-b498-5eb3b26ad335 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.505057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541138-e0c2-4f4f-b498-5eb3b26ad335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.526115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:23.545727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ae541138-e0c2-4f4f-b498-5eb3b26ad335 None None] MFA Rules not processed for user `3380e12364ed4427830962d76df23a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:23.546726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ae541138-e0c2-4f4f-b498-5eb3b26ad335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:23.591028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 802/1608] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:23.591028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f3b88-076b-4ecc-81d8-a56a44840565 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.591028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f3b88-076b-4ecc-81d8-a56a44840565 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.591028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f3b88-076b-4ecc-81d8-a56a44840565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.628564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-186f3b88-076b-4ecc-81d8-a56a44840565 None None] MFA Rules not processed for user `a1b5c7459d4a4833b94cb6e79c80ca71`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:23.630252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-186f3b88-076b-4ecc-81d8-a56a44840565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:23.675646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 807/1609] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:23.675646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc155afd-f0db-46f3-a365-bb66d2b7fb25 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.675646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc155afd-f0db-46f3-a365-bb66d2b7fb25 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.675646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc155afd-f0db-46f3-a365-bb66d2b7fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.715760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-dc155afd-f0db-46f3-a365-bb66d2b7fb25 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:23.717597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-dc155afd-f0db-46f3-a365-bb66d2b7fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:23.735157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 803/1610] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:23.736792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff87e-8340-42ee-b152-aec030ccd814 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.737220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff87e-8340-42ee-b152-aec030ccd814 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.737589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff87e-8340-42ee-b152-aec030ccd814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.763469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-bfdff87e-8340-42ee-b152-aec030ccd814 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:23.764893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bfdff87e-8340-42ee-b152-aec030ccd814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:23.867078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 808/1611] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:23.867833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6ad0-7521-42cd-970e-de8fde3e2903 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.868169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6ad0-7521-42cd-970e-de8fde3e2903 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.868391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6ad0-7521-42cd-970e-de8fde3e2903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.884248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 804/1612] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:23.886374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98ef9f-9015-4934-987f-814ef24c9367 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:23.886669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98ef9f-9015-4934-987f-814ef24c9367 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:23.887009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98ef9f-9015-4934-987f-814ef24c9367 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:23.888854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 805/1613] 10.222.0.13 () {54 vars in 962 bytes} [Sat Sep 3 03:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:49:23.889591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98ef9f-9015-4934-987f-814ef24c9367 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:23.926720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f46c6ad0-7521-42cd-970e-de8fde3e2903 None None] MFA Rules not processed for user `8e91c9887e494f94b275f4b6d293942d`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:23.927996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f46c6ad0-7521-42cd-970e-de8fde3e2903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:23.994487 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98ef9f-9015-4934-987f-814ef24c9367 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.002761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.003388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.004060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.004661 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.025335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.027881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.040270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:24.058031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 809/1614] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:24.059202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6ad0-7521-42cd-970e-de8fde3e2903 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.065541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 806/1615] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:24.069298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.073270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6ad0-7521-42cd-970e-de8fde3e2903 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.076381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:24.080437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224da041-5b86-416a-8ee8-2a3da36df459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.081581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da041-5b86-416a-8ee8-2a3da36df459 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.082372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da041-5b86-416a-8ee8-2a3da36df459 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.083240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da041-5b86-416a-8ee8-2a3da36df459 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.084139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224da041-5b86-416a-8ee8-2a3da36df459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.086526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224da041-5b86-416a-8ee8-2a3da36df459 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.133230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 810/1616] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:24 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:24.134879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fa684-8f86-4937-bea0-0d1d18e34a76 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.135166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fa684-8f86-4937-bea0-0d1d18e34a76 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.135436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fa684-8f86-4937-bea0-0d1d18e34a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.242872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e55db3-92f0-40e4-8f11-17c9029c9a1f service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.261667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-1f2fa684-8f86-4937-bea0-0d1d18e34a76 None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:24.262921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1f2fa684-8f86-4937-bea0-0d1d18e34a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:24.363839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.365737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.365737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.365737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.417331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 811/1617] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Sep 3 03:49:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:24.425685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fa684-8f86-4937-bea0-0d1d18e34a76 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.441646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fa684-8f86-4937-bea0-0d1d18e34a76 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.466590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.466590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.466590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.466590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.532784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.534211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.555838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 807/1618] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:24.558684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.582184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2d47a-8d6c-467c-9419-fc4e7726cdbd service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.593621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.595054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.595271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.595512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.596154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.597899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.598077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.599786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.612106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 812/1619] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:24.613616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.625955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019b8ae-260b-4cb8-b5d5-6d50b3d15f61 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.634308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.635571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.635975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.636333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.637209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.640408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.656364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 808/1620] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:24 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:24.658584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.698310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 813/1621] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:24 2022] POST /identity/v3/users => generated 309 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:24.699188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.711098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c4997-32e7-4a08-8248-6b6878b2a632 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.759213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:24.768757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:24.821812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0513-ff15-44b0-93e5-116df481e960 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.832080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.832792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.834721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.834721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.834956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.835558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.836300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.836641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.837004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.840111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.886266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 814/1622] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:24 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:24.887227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.907352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10410214-b5fc-4135-897a-db52d452c047 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.923222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:24.924170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:24.926212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:24.926590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:24.927360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.930086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.957913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 815/1623] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:24.963919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:24.968786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:24.973275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:24.986353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6f5bf-bc30-4b4f-b67b-c7e7c60a9d13 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:24.994876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 809/1624] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:24.996313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:25.000715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:25.006238 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.007197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.008319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.008742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dbd01-89f6-4c62-a676-5276a7fa2b7c service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:25.010447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:25.014049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:25.014806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.015161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.015511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] PATH_INFO: `/v3/projects/d5d4909bb0d74ed7a4dbf86c1b140a42/users/4f330808d1de4e51ac4ffcc29dfc9e19/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.015643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:25.041119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 816/1625] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:25.046064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d4909bb0d74ed7a4dbf86c1b140a42, user_id=4f330808d1de4e51ac4ffcc29dfc9e19, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:25.048892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:25.052627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:25.087438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 810/1626] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:24 2022] PUT /identity/v3/projects/d5d4909bb0d74ed7a4dbf86c1b140a42/users/4f330808d1de4e51ac4ffcc29dfc9e19/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:25.092228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf04529-9b30-4d7b-914d-f5f15f342cfc admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:25.100564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:25.287424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb525b-ff65-4db1-aacb-3ebd974bfbf7 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:25.299860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:25.300612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.301031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.301961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] PATH_INFO: `/v3/projects/152da6c29e9e42d9914ce09f4be7cb2b/users/1b791d7adf9d420bb9d9a2ec3cd4cef8/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.310029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:25.310667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.310949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.311228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.311879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:25.313600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:25.319683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152da6c29e9e42d9914ce09f4be7cb2b, user_id=1b791d7adf9d420bb9d9a2ec3cd4cef8, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:25.323158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:25.346875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 811/1627] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:25.347817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:25.352995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 817/1628] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:25 2022] PUT /identity/v3/projects/152da6c29e9e42d9914ce09f4be7cb2b/users/1b791d7adf9d420bb9d9a2ec3cd4cef8/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:25.354974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:25.370534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97bdf5-9caf-4288-932b-c45003a41a01 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:25.491000 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:25.509679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e6fba-f00c-4a94-a4e2-e296f531d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:25.510763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6fba-f00c-4a94-a4e2-e296f531d483 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.513306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6fba-f00c-4a94-a4e2-e296f531d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.513818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e6fba-f00c-4a94-a4e2-e296f531d483 admin admin] PATH_INFO: `/v3/projects/d5d4909bb0d74ed7a4dbf86c1b140a42/users/4f330808d1de4e51ac4ffcc29dfc9e19/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.520487 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6fba-f00c-4a94-a4e2-e296f531d483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d4909bb0d74ed7a4dbf86c1b140a42, user_id=4f330808d1de4e51ac4ffcc29dfc9e19, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:25.528680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac323944-e1ee-4994-bb46-093860f87841 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:25.529266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e6fba-f00c-4a94-a4e2-e296f531d483 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:25.539613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24278e92-ed6a-4cce-86f5-418913c2da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:25.540262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278e92-ed6a-4cce-86f5-418913c2da24 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.540541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278e92-ed6a-4cce-86f5-418913c2da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.540859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24278e92-ed6a-4cce-86f5-418913c2da24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.543543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24278e92-ed6a-4cce-86f5-418913c2da24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:25.550048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24278e92-ed6a-4cce-86f5-418913c2da24 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:25.574353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 812/1629] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:25 2022] PUT /identity/v3/projects/d5d4909bb0d74ed7a4dbf86c1b140a42/users/4f330808d1de4e51ac4ffcc29dfc9e19/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:25.575553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 818/1630] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:25.576544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63806f5-50a9-4261-b574-ddd7fcfeb4a4 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.577018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e552-1bc2-4cee-af2a-a39128fd324c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.577308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e552-1bc2-4cee-af2a-a39128fd324c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.577557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63806f5-50a9-4261-b574-ddd7fcfeb4a4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.577674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e552-1bc2-4cee-af2a-a39128fd324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.578148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63806f5-50a9-4261-b574-ddd7fcfeb4a4 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.580266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 813/1631] 10.222.0.13 () {54 vars in 912 bytes} [Sat Sep 3 03:49:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:49:25.581460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63806f5-50a9-4261-b574-ddd7fcfeb4a4 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:25.632341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:25.641217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8784e552-1bc2-4cee-af2a-a39128fd324c None None] MFA Rules not processed for user `4f330808d1de4e51ac4ffcc29dfc9e19`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:25.642511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8784e552-1bc2-4cee-af2a-a39128fd324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:25.667501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63806f5-50a9-4261-b574-ddd7fcfeb4a4 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:25.675159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3762-1d55-492f-b3b8-6f8371dda44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:25.676166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3762-1d55-492f-b3b8-6f8371dda44c admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.677297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3762-1d55-492f-b3b8-6f8371dda44c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.677816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3762-1d55-492f-b3b8-6f8371dda44c admin admin] PATH_INFO: `/v3/projects/152da6c29e9e42d9914ce09f4be7cb2b/users/1b791d7adf9d420bb9d9a2ec3cd4cef8/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.681241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3762-1d55-492f-b3b8-6f8371dda44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=152da6c29e9e42d9914ce09f4be7cb2b, user_id=1b791d7adf9d420bb9d9a2ec3cd4cef8, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:25.693279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb3762-1d55-492f-b3b8-6f8371dda44c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:25.724337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 814/1632] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:25 2022] PUT /identity/v3/projects/152da6c29e9e42d9914ce09f4be7cb2b/users/1b791d7adf9d420bb9d9a2ec3cd4cef8/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:25.733673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948d0e3-0fb6-4b8a-a1cd-f1cdb44dc7d7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.733673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948d0e3-0fb6-4b8a-a1cd-f1cdb44dc7d7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.733673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948d0e3-0fb6-4b8a-a1cd-f1cdb44dc7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.782486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d948d0e3-0fb6-4b8a-a1cd-f1cdb44dc7d7 None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:25.785396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d948d0e3-0fb6-4b8a-a1cd-f1cdb44dc7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:25.803111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 819/1633] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:25.804578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aadd59-ceae-48a2-9c82-9faf23faddb5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:25.804868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aadd59-ceae-48a2-9c82-9faf23faddb5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:25.805148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aadd59-ceae-48a2-9c82-9faf23faddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:25.871252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-43aadd59-ceae-48a2-9c82-9faf23faddb5 None None] MFA Rules not processed for user `1b791d7adf9d420bb9d9a2ec3cd4cef8`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:25.876690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-43aadd59-ceae-48a2-9c82-9faf23faddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:25.954063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 815/1634] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:25.955456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948d0e3-0fb6-4b8a-a1cd-f1cdb44dc7d7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:26.109740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 820/1635] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:26.109740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aadd59-ceae-48a2-9c82-9faf23faddb5 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:26.128376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aadd59-ceae-48a2-9c82-9faf23faddb5 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:26.130660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948d0e3-0fb6-4b8a-a1cd-f1cdb44dc7d7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:26.132708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:26.133443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:26.133853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:26.134215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:26.137126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:26.138432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:26.138866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:26.139689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:26.151979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:26.154105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:26.184287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 821/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:26.240355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:26.375289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:26.378256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:26.395588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 816/1637] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:25 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:26.489594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:26.501416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc87985-21f4-4052-aab4-3db9bc22dea1 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:26.525874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:26.526561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:26.526945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:26.527135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:26.554729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:26.556903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:26.574492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 822/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:27.074790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:27.086064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79454313-3984-4d26-8435-010086b03ab7 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:27.091266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9f688-6133-4319-8aee-bb9fd6ac5078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:27.092073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9f688-6133-4319-8aee-bb9fd6ac5078 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:27.092489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9f688-6133-4319-8aee-bb9fd6ac5078 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:27.092858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9f688-6133-4319-8aee-bb9fd6ac5078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:27.187096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9f688-6133-4319-8aee-bb9fd6ac5078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:27.189667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9f688-6133-4319-8aee-bb9fd6ac5078 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:27.214326 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 817/1639] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:27.539530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:27.563233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:27.619322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9de5d-f5e3-47f9-9ba7-8feb4817fa11 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:27.620237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9de5d-f5e3-47f9-9ba7-8feb4817fa11 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:27.620773 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9de5d-f5e3-47f9-9ba7-8feb4817fa11 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:27.623599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 818/1640] 10.222.0.13 () {54 vars in 962 bytes} [Sat Sep 3 03:49:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:49:27.644881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc02b-d238-4b44-a91e-67d006c4336e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:27.645568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc02b-d238-4b44-a91e-67d006c4336e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:27.646947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc02b-d238-4b44-a91e-67d006c4336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:27.680545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-02bbc02b-d238-4b44-a91e-67d006c4336e None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:27.682575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-02bbc02b-d238-4b44-a91e-67d006c4336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:27.718113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 819/1641] 10.222.0.13 () {58 vars in 1059 bytes} [Sat Sep 3 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:27.724744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574ba3-e80b-4a97-8e9d-35ded7444d0c None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:27.725269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574ba3-e80b-4a97-8e9d-35ded7444d0c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:27.728427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574ba3-e80b-4a97-8e9d-35ded7444d0c None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:27.733946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 820/1642] 10.222.0.13 () {54 vars in 912 bytes} [Sat Sep 3 03:49:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:49:27.752273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1add2-1e32-4e93-8c32-05d8cb7a05df None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:27.752723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1add2-1e32-4e93-8c32-05d8cb7a05df None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:27.753313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1add2-1e32-4e93-8c32-05d8cb7a05df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:27.808472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984496-e5af-4607-8e0d-57047eac8402 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:27.825600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:27.825600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:27.825600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:27.826242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] PATH_INFO: `/v3/users/a1b5c7459d4a4833b94cb6e79c80ca71` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:27.831991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b5c7459d4a4833b94cb6e79c80ca71)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:27.833101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: WARNING py.warnings [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:49:27.833101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: warnings.warn(msg) Sep 03 03:49:27.833101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: Sep 03 03:49:27.834395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:27.844191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-30c1add2-1e32-4e93-8c32-05d8cb7a05df None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:27.849628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-30c1add2-1e32-4e93-8c32-05d8cb7a05df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:27.891514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 821/1643] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:27.898980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1add2-1e32-4e93-8c32-05d8cb7a05df None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:27.923265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1add2-1e32-4e93-8c32-05d8cb7a05df None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:27.932428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58a30f-6ff2-4a2b-b650-0fec18736b6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:27.934193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58a30f-6ff2-4a2b-b650-0fec18736b6b service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:27.934694 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58a30f-6ff2-4a2b-b650-0fec18736b6b service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:27.935282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58a30f-6ff2-4a2b-b650-0fec18736b6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:27.961947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58a30f-6ff2-4a2b-b650-0fec18736b6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:27.963791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58a30f-6ff2-4a2b-b650-0fec18736b6b service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:27.974338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b5c7459d4a4833b94cb6e79c80ca71'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:27.975353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b5c7459d4a4833b94cb6e79c80ca71'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:27.993445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b5c7459d4a4833b94cb6e79c80ca71'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:27.994332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b5c7459d4a4833b94cb6e79c80ca71'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:28.004420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 822/1644] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:49:28.039074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b5c7459d4a4833b94cb6e79c80ca71'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:28.084524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 823/1645] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:27 2022] DELETE /identity/v3/users/a1b5c7459d4a4833b94cb6e79c80ca71 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:28.091330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:28.091792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:28.092351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:28.176807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:28.181668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:28.358849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 823/1646] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:28.409639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:28.411125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:28.569435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848f22e-f17d-4d97-a619-8f5e6a9a4b5a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:28.584105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:28.585065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:28.585471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:28.585879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:28.610909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:28.613067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:28.648290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 824/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:30.438397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:30.440151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:30.459878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58be3e2-7272-492d-902e-a1b8cbbb554c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:30.484655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:30.486177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:30.486524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:30.486882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] PATH_INFO: `/v3/projects/b399dec697094d91abb0ae9409d21a62` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:30.490377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b399dec697094d91abb0ae9409d21a62)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:30.491774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: WARNING py.warnings [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 03:49:30.491774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: warnings.warn(msg) Sep 03 03:49:30.491774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: Sep 03 03:49:30.493716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:30.600419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:30.644590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b399dec697094d91abb0ae9409d21a62', 'request_id': 'req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.663546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b399dec697094d91abb0ae9409d21a62', 'request_id': 'req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.671141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b399dec697094d91abb0ae9409d21a62', 'request_id': 'req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.701490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] The token cache is being invalidate because project b399dec697094d91abb0ae9409d21a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:49:30.701802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.704484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.711598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 824/1648] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:49:30 2022] DELETE /identity/v3/projects/b399dec697094d91abb0ae9409d21a62 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:30.716154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:30.733487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56ed6-7f36-4d01-9335-6198d6e1a575 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:30.803372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:30.851895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:30.853418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:30.854156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:30.854556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] PATH_INFO: `/v3/users/4f330808d1de4e51ac4ffcc29dfc9e19` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:30.856079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f330808d1de4e51ac4ffcc29dfc9e19)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:30.858394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:30.939887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f330808d1de4e51ac4ffcc29dfc9e19'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.941715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f330808d1de4e51ac4ffcc29dfc9e19'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.957084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f330808d1de4e51ac4ffcc29dfc9e19'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.959567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f330808d1de4e51ac4ffcc29dfc9e19'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:30.984937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fdaef4b6-f84d-4e05-a344-3e1928528dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f330808d1de4e51ac4ffcc29dfc9e19'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:31.005470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 825/1649] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:30 2022] DELETE /identity/v3/users/4f330808d1de4e51ac4ffcc29dfc9e19 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:32.201284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:32.203572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:32.236437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e58eb-f450-43af-8b54-a5dd02aa8a5f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:32.475754 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:32.476860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:32.477176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:32.477458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] PATH_INFO: `/v3/projects/d5d4909bb0d74ed7a4dbf86c1b140a42` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:32.485698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d4909bb0d74ed7a4dbf86c1b140a42)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:32.487920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:32.644467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d4909bb0d74ed7a4dbf86c1b140a42', 'request_id': 'req-58688a42-629f-4fa5-8c76-60f9a59107e7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:32.674294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d4909bb0d74ed7a4dbf86c1b140a42', 'request_id': 'req-58688a42-629f-4fa5-8c76-60f9a59107e7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:32.694581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d4909bb0d74ed7a4dbf86c1b140a42', 'request_id': 'req-58688a42-629f-4fa5-8c76-60f9a59107e7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:32.731978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] The token cache is being invalidate because project d5d4909bb0d74ed7a4dbf86c1b140a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:49:32.732286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:32.734770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58688a42-629f-4fa5-8c76-60f9a59107e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:32.741600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 825/1650] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:49:32 2022] DELETE /identity/v3/projects/d5d4909bb0d74ed7a4dbf86c1b140a42 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:32.743300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aca99-1f3d-4bdb-aa8e-c2c8c021a247 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:32.743783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aca99-1f3d-4bdb-aa8e-c2c8c021a247 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:32.743961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aca99-1f3d-4bdb-aa8e-c2c8c021a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:32.812072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-624aca99-1f3d-4bdb-aa8e-c2c8c021a247 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:32.821797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-624aca99-1f3d-4bdb-aa8e-c2c8c021a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:33.045605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 826/1651] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:33.054883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf49c0-6a30-4d14-b264-704c0fd4a29b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:33.055159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf49c0-6a30-4d14-b264-704c0fd4a29b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:33.055438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf49c0-6a30-4d14-b264-704c0fd4a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:33.106185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-91bf49c0-6a30-4d14-b264-704c0fd4a29b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:33.107396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-91bf49c0-6a30-4d14-b264-704c0fd4a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:33.139359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 826/1652] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:33.140712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aca99-1f3d-4bdb-aa8e-c2c8c021a247 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:33.168979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aca99-1f3d-4bdb-aa8e-c2c8c021a247 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:33.185577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:33.188599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:33.188710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:33.188962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:33.190273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:33.190587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:33.196180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:33.244073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 827/1653] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:49:33.248186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf49c0-6a30-4d14-b264-704c0fd4a29b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:33.260366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf49c0-6a30-4d14-b264-704c0fd4a29b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:33.273688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:33.274600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:33.275106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:33.275738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:33.278228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:33.284007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:33.411562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 827/1654] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:33 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:33.415718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:33.431261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc39f3b-b4b6-4f52-9d86-7273cec94049 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:33.607403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:33.704994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:33.706522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:33.708228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:33.709431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:33.711690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:33.726173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:33.810053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 828/1655] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:33 2022] POST /identity/v3/users => generated 287 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:49:33.814690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:33.829908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40379e7-9d2d-41fc-9053-83cc1cbc528f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:33.839010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:33.841160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:33.841717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:33.842908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:33.844384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:33.854604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:33.893265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 828/1656] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:33.897036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:33.917291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:33.919904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:33.931073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0257-1481-4a44-9d65-f5f97cd62a3d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:33.962609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:33.963448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:33.963867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:33.964274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:33.965094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:33.967328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:33.970475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db9f93-3f66-436a-8c41-cd7bb2bd657c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:33.985111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:33.986006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:33.986666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:33.991598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] PATH_INFO: `/v3/users/0845ac8c41aa47109ed5fa8375182c35` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:33.994243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0845ac8c41aa47109ed5fa8375182c35)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:34.004618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:34.006641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 829/1657] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:34.011076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:34.019136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:34.035089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d4120-801a-4c31-b17f-e51e5dbf113e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:34.066636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cee006-d210-4611-a1cd-2c4ab8e7b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:34.067329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cee006-d210-4611-a1cd-2c4ab8e7b836 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:34.067608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cee006-d210-4611-a1cd-2c4ab8e7b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:34.067879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cee006-d210-4611-a1cd-2c4ab8e7b836 admin admin] PATH_INFO: `/v3/projects/718d27e0fd094dd38f085bcd8d6114e3/users/072096cd67944a2fa9f22b10f2af5632/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:34.132381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cee006-d210-4611-a1cd-2c4ab8e7b836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718d27e0fd094dd38f085bcd8d6114e3, user_id=072096cd67944a2fa9f22b10f2af5632, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:34.137411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cee006-d210-4611-a1cd-2c4ab8e7b836 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:34.159953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0845ac8c41aa47109ed5fa8375182c35'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:34.163064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0845ac8c41aa47109ed5fa8375182c35'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:34.195715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0845ac8c41aa47109ed5fa8375182c35'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:34.200961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 830/1658] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:34 2022] PUT /identity/v3/projects/718d27e0fd094dd38f085bcd8d6114e3/users/072096cd67944a2fa9f22b10f2af5632/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:34.219001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0845ac8c41aa47109ed5fa8375182c35'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:34.220111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e111c64e-e4b2-4af5-8d44-005e494b188e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0845ac8c41aa47109ed5fa8375182c35'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:34.222444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be752100-01d2-44ba-912f-de365477373d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:34.223378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be752100-01d2-44ba-912f-de365477373d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:34.223724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be752100-01d2-44ba-912f-de365477373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:34.260177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-be752100-01d2-44ba-912f-de365477373d None None] MFA Rules not processed for user `072096cd67944a2fa9f22b10f2af5632`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:34.261646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-be752100-01d2-44ba-912f-de365477373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:34.289141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 829/1659] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:33 2022] DELETE /identity/v3/users/0845ac8c41aa47109ed5fa8375182c35 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:34.294408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14063e4-d191-41f6-a2c5-9ed3867307e6 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:34.294699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14063e4-d191-41f6-a2c5-9ed3867307e6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:34.294979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14063e4-d191-41f6-a2c5-9ed3867307e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:34.367383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e14063e4-d191-41f6-a2c5-9ed3867307e6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:34.368668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e14063e4-d191-41f6-a2c5-9ed3867307e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:34.497037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 831/1660] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:49:34.498328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be752100-01d2-44ba-912f-de365477373d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:34.499309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-be752100-01d2-44ba-912f-de365477373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:34.634975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 830/1661] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:34.746109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be752100-01d2-44ba-912f-de365477373d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:34.754957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:34.755539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:34.755978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:34.756388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:34.757218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:34.761262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:34.824052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 832/1662] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:34 2022] POST /identity/v3/projects => generated 371 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:34.824653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14063e4-d191-41f6-a2c5-9ed3867307e6 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:34.847311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14063e4-d191-41f6-a2c5-9ed3867307e6 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:34.862600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:34.864780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:34.890368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:34.989742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266088e-71bf-4968-85fc-9928ec770e68 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:35.004856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:35.005597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:35.005826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:35.006113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:35.040594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:35.041273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:35.041684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:35.041967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:35.042732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:35.057485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:35.131029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 831/1663] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:34 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:49:35.135100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:35.170681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:35.172220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:35.201781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 833/1664] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:49:35.216726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c51dc9-8c8d-4c82-898f-3656a5c8a73c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:35.235998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:35.236653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:35.236955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:35.237296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:35.239146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:35.240957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:35.273844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 832/1665] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:35.277953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:35.295560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d817c3-8494-490e-9bb9-762fc27883d9 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:35.309290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:35.310091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:35.310387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:35.310659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] PATH_INFO: `/v3/projects/28915f3d2ea140719b114ffe73c50bbb/users/2061a1844c414bdb8d0af0d747a8b3fd/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:35.355249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28915f3d2ea140719b114ffe73c50bbb, user_id=2061a1844c414bdb8d0af0d747a8b3fd, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:35.358266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:35.389598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 834/1666] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:35 2022] PUT /identity/v3/projects/28915f3d2ea140719b114ffe73c50bbb/users/2061a1844c414bdb8d0af0d747a8b3fd/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:35.394722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:35.401012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:35.426026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdeeb0-2532-472a-9ffa-25449af44117 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:35.600206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aec333-015d-4e91-9acb-f247426f4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:35.600849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec333-015d-4e91-9acb-f247426f4ddb admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:35.602879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec333-015d-4e91-9acb-f247426f4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:35.603186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aec333-015d-4e91-9acb-f247426f4ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:35.604680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aec333-015d-4e91-9acb-f247426f4ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:35.609780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aec333-015d-4e91-9acb-f247426f4ddb admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:35.651009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 833/1667] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:35.655562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:35.674779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96556c7d-d084-469c-a1ea-4117da98ec93 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:35.686948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:35.687697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:35.688000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:35.688361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] PATH_INFO: `/v3/projects/28915f3d2ea140719b114ffe73c50bbb/users/2061a1844c414bdb8d0af0d747a8b3fd/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:35.690510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28915f3d2ea140719b114ffe73c50bbb, user_id=2061a1844c414bdb8d0af0d747a8b3fd, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:35.693614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:35.729552 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac229013-007d-49ca-a2d5-5a4945198d62 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:35.729850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac229013-007d-49ca-a2d5-5a4945198d62 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:35.730134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac229013-007d-49ca-a2d5-5a4945198d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:35.732815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 835/1668] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:35 2022] PUT /identity/v3/projects/28915f3d2ea140719b114ffe73c50bbb/users/2061a1844c414bdb8d0af0d747a8b3fd/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:35.830189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ac229013-007d-49ca-a2d5-5a4945198d62 None None] MFA Rules not processed for user `2061a1844c414bdb8d0af0d747a8b3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:35.831456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ac229013-007d-49ca-a2d5-5a4945198d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:35.989459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 834/1669] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:36.026744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:36.030644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:36.137043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368e68-c2ca-43b3-9ac0-b9c2e637503d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:36.141657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:36.142577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:36.143226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:36.143692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:36.160707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:36.162499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:36.186828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 836/1670] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:37.266193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac229013-007d-49ca-a2d5-5a4945198d62 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:37.453186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac229013-007d-49ca-a2d5-5a4945198d62 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:37.470070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:37.470758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:37.473035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:37.473331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] PATH_INFO: `/v3/users/072096cd67944a2fa9f22b10f2af5632` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:37.474992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072096cd67944a2fa9f22b10f2af5632)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:37.477634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:37.540647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:37.570150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:37.571926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:37.590156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072096cd67944a2fa9f22b10f2af5632'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.591207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072096cd67944a2fa9f22b10f2af5632'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.602744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072096cd67944a2fa9f22b10f2af5632'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.614298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c6efd-8d36-43e7-bf26-d7a0cac5d3dd service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:37.631837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:37.632782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:37.633463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072096cd67944a2fa9f22b10f2af5632'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.633671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:37.634146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a635b025-dadb-47b9-ae80-814e59289001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072096cd67944a2fa9f22b10f2af5632'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.634246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] PATH_INFO: `/v3/projects/ee7ec7906b3a4e8f81b975b95df1a1e4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:37.640188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7ec7906b3a4e8f81b975b95df1a1e4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:37.642532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:37.707932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:37.733134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 835/1671] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:37 2022] DELETE /identity/v3/users/072096cd67944a2fa9f22b10f2af5632 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:37.737346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd09be-78c2-4b2d-9457-d48e82d55248 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:37.737772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd09be-78c2-4b2d-9457-d48e82d55248 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:37.738152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd09be-78c2-4b2d-9457-d48e82d55248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:37.777860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7ec7906b3a4e8f81b975b95df1a1e4', 'request_id': 'req-963aa081-bf35-4308-abce-1dc545818ccc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.794079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7ec7906b3a4e8f81b975b95df1a1e4', 'request_id': 'req-963aa081-bf35-4308-abce-1dc545818ccc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.803158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7ec7906b3a4e8f81b975b95df1a1e4', 'request_id': 'req-963aa081-bf35-4308-abce-1dc545818ccc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.827095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e4fd09be-78c2-4b2d-9457-d48e82d55248 None None] MFA Rules not processed for user `8f581ef77233477cbfdb987c3b2508ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:37.830617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] The token cache is being invalidate because project ee7ec7906b3a4e8f81b975b95df1a1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:49:37.830816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e4fd09be-78c2-4b2d-9457-d48e82d55248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:37.831235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.833179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:37.839910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 837/1672] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:49:37 2022] DELETE /identity/v3/projects/ee7ec7906b3a4e8f81b975b95df1a1e4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:37.840865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:37.844840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.010731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 836/1673] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:38.011236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa081-bf35-4308-abce-1dc545818ccc admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:38.022421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650b80-9228-4677-8484-3650e5133524 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.022878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650b80-9228-4677-8484-3650e5133524 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.023256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650b80-9228-4677-8484-3650e5133524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.035484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:38.036160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.036599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.036881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] PATH_INFO: `/v3/users/3380e12364ed4427830962d76df23a5d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.053872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3380e12364ed4427830962d76df23a5d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:38.055912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:38.066921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-cd650b80-9228-4677-8484-3650e5133524 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:38.068280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cd650b80-9228-4677-8484-3650e5133524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.082603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 837/1674] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:38.084006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cba5f-8c44-4c9f-b938-55173e625ccb None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.084365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cba5f-8c44-4c9f-b938-55173e625ccb None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.084716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cba5f-8c44-4c9f-b938-55173e625ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.123957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-147cba5f-8c44-4c9f-b938-55173e625ccb None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:38.125385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-147cba5f-8c44-4c9f-b938-55173e625ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.153058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 838/1675] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:38.154631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.154931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.155173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.181152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3380e12364ed4427830962d76df23a5d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:38.182179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3380e12364ed4427830962d76df23a5d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:38.188002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] MFA Rules not processed for user `8f581ef77233477cbfdb987c3b2508ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:38.189625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.194448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3380e12364ed4427830962d76df23a5d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:38.196043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3380e12364ed4427830962d76df23a5d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:38.199968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 839/1676] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:38.205483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:38.212311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.219980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-169c7f1e-cb53-4d6e-9873-b8e8bff30c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3380e12364ed4427830962d76df23a5d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:38.238771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 838/1677] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:37 2022] DELETE /identity/v3/users/3380e12364ed4427830962d76df23a5d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:38.240563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.241074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.241543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.271461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:38.273172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.309751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:38.325411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624fd88-b662-4658-8b38-d5dcd28b4556 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:38.362483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:38.373147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 839/1678] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:38.373147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:38.373147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.428655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41895c3-26e9-4b32-9449-b47ef1793474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:38.429672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41895c3-26e9-4b32-9449-b47ef1793474 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.429968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41895c3-26e9-4b32-9449-b47ef1793474 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.430288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41895c3-26e9-4b32-9449-b47ef1793474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.432194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d41895c3-26e9-4b32-9449-b47ef1793474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.448858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41895c3-26e9-4b32-9449-b47ef1793474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:38.450452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41895c3-26e9-4b32-9449-b47ef1793474 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:38.470793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 840/1679] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:38.472173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cc76e-00d0-4fb2-8069-d455ddeb4152 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.472468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cc76e-00d0-4fb2-8069-d455ddeb4152 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.473555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cc76e-00d0-4fb2-8069-d455ddeb4152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.497567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1d403-cfcc-4c9a-ba11-52269a4f510b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:38.511923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2c6cc76e-00d0-4fb2-8069-d455ddeb4152 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:38.513215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2c6cc76e-00d0-4fb2-8069-d455ddeb4152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.515378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:38.516111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.516448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.516845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.520669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.539589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 841/1680] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:38.539589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cc76e-00d0-4fb2-8069-d455ddeb4152 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:38.568697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cc76e-00d0-4fb2-8069-d455ddeb4152 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:38.622151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:38.623230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.623761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.625226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.627354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:38.627985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:38.630089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:38.662507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:38.666226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:38.672512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 842/1681] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:38.675066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:38.680047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 840/1682] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:38.680759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:38.703471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e876e6d-b696-4bf5-91f6-2c3fb4cc3305 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:38.716240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c055d6d-1f0e-4545-b458-90a984e96941 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:38.720059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:38.720973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.721588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710fe1e-5f6b-4d27-9254-5e4582ed9de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:38.722247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710fe1e-5f6b-4d27-9254-5e4582ed9de1 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.722790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710fe1e-5f6b-4d27-9254-5e4582ed9de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.722790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710fe1e-5f6b-4d27-9254-5e4582ed9de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.729268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.729623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.730363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:38.732510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:38.751600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710fe1e-5f6b-4d27-9254-5e4582ed9de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:38.755758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710fe1e-5f6b-4d27-9254-5e4582ed9de1 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:38.794422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 843/1683] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:38.798842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:38.803119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:38.803499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:38.804471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 841/1684] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:38.808737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:38.880356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] MFA Rules not processed for user `e41cfa8ce3a847738325ef2952b41e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:38.882066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:38.939823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:38.976715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3633f-9f25-48a4-af25-2eec86438fd2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:39.000220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:39.001272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.001560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.001897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.002559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:39.004556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:39.063058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 844/1685] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:39.080568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:39.081975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:39.091524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 842/1686] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:38 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:49:39.095062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:39.115567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade097f0-0693-419d-a64f-71905197932c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:39.129729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:39.130482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.130710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.130985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.131797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:39.134407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:39.169927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 843/1687] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:39.174143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:39.198541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c2068-6fdd-430a-8762-9c23b9504cb3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:39.221729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:39.222479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.222816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.223256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.223786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:39.229710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:39.250851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 844/1688] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:39.260773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:39.287600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198497d-0622-412a-876d-7282c430d1f9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:39.304740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0a4e6-1590-4aeb-9175-295742bfba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:39.304740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0a4e6-1590-4aeb-9175-295742bfba58 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.304740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0a4e6-1590-4aeb-9175-295742bfba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.304740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0a4e6-1590-4aeb-9175-295742bfba58 admin admin] PATH_INFO: `/v3/projects/8e21789e89894aa9b569aae68b2d22c6/users/d7646c10b9ef4c52add9de5f7993f8d4/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.328835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58ce03-fe99-4c19-a37f-eb3e76861172 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:39.331570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0a4e6-1590-4aeb-9175-295742bfba58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e21789e89894aa9b569aae68b2d22c6, user_id=d7646c10b9ef4c52add9de5f7993f8d4, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:39.334355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0a4e6-1590-4aeb-9175-295742bfba58 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:39.337895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1387f-4420-47a1-98d6-4ff0ced1ee00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:39.338547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1387f-4420-47a1-98d6-4ff0ced1ee00 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.338836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1387f-4420-47a1-98d6-4ff0ced1ee00 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.339124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1387f-4420-47a1-98d6-4ff0ced1ee00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.362483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 845/1689] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:39 2022] PUT /identity/v3/projects/8e21789e89894aa9b569aae68b2d22c6/users/d7646c10b9ef4c52add9de5f7993f8d4/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:39.363548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88a02-dc46-4db0-bb97-53009e6dca00 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.363836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88a02-dc46-4db0-bb97-53009e6dca00 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.364252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad88a02-dc46-4db0-bb97-53009e6dca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.371427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1387f-4420-47a1-98d6-4ff0ced1ee00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:39.381873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1387f-4420-47a1-98d6-4ff0ced1ee00 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:39.418916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 845/1690] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:49:39.420358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7efe4-9bcd-4d0f-9e9f-366693f45f4f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.420648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7efe4-9bcd-4d0f-9e9f-366693f45f4f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.420939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7efe4-9bcd-4d0f-9e9f-366693f45f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.439317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-1ad88a02-dc46-4db0-bb97-53009e6dca00 None None] MFA Rules not processed for user `44a51adff4c546da9c7f476e58e2fc88`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:39.441804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1ad88a02-dc46-4db0-bb97-53009e6dca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:39.520351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:39.537970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-b2c7efe4-9bcd-4d0f-9e9f-366693f45f4f None None] MFA Rules not processed for user `d7646c10b9ef4c52add9de5f7993f8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:39.540138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b2c7efe4-9bcd-4d0f-9e9f-366693f45f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:39.645425 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 846/1691] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:39.657052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2b14-a81a-4d28-b1e2-4efec1f48ecd None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.657655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2b14-a81a-4d28-b1e2-4efec1f48ecd None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.658025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2b14-a81a-4d28-b1e2-4efec1f48ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.697953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-129b2b14-a81a-4d28-b1e2-4efec1f48ecd None None] MFA Rules not processed for user `44a51adff4c546da9c7f476e58e2fc88`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:39.706473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-129b2b14-a81a-4d28-b1e2-4efec1f48ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:39.732533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 847/1692] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:49:39.765880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2b14-a81a-4d28-b1e2-4efec1f48ecd None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:39.768419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 846/1693] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:39.773397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7efe4-9bcd-4d0f-9e9f-366693f45f4f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:39.941001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2b14-a81a-4d28-b1e2-4efec1f48ecd None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:39.968555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:39.969406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:39.969839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:39.970331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:39.984965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7efe4-9bcd-4d0f-9e9f-366693f45f4f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:39.987606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:39.997936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.000363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.001720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ae52b-bc63-465f-9e9c-800c2dd781de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.002370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae52b-bc63-465f-9e9c-800c2dd781de admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.002654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae52b-bc63-465f-9e9c-800c2dd781de admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.002930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ae52b-bc63-465f-9e9c-800c2dd781de admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.003579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ae52b-bc63-465f-9e9c-800c2dd781de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.010801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ae52b-bc63-465f-9e9c-800c2dd781de admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.029392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 848/1694] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:40.075032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 847/1695] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:39 2022] POST /identity/v3/projects => generated 387 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:40.079394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:40.111488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea210eb-95b9-4894-b322-f299044fab72 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:40.274473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.276087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.276996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.277360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.278178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.280233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.323510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98ebf-3963-475b-94ad-2465f2444e71 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.324042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98ebf-3963-475b-94ad-2465f2444e71 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.324527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a98ebf-3963-475b-94ad-2465f2444e71 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.327470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 848/1696] 10.222.0.13 () {54 vars in 912 bytes} [Sat Sep 3 03:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:49:40.335143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6fa26-fcca-44b3-88c9-d862b11bc246 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.336831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6fa26-fcca-44b3-88c9-d862b11bc246 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.337330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6fa26-fcca-44b3-88c9-d862b11bc246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.340739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 849/1697] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:40 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:40.347301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:40.370837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ee20-2ed3-4aa4-8e8b-bb9dce897886 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:40.382035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.382567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.382852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.383129 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.386627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.388359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.414908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4cb6fa26-fcca-44b3-88c9-d862b11bc246 None None] MFA Rules not processed for user `c1a7ee9f78da46e4abe27eadb2d17b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:40.419564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4cb6fa26-fcca-44b3-88c9-d862b11bc246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:40.423978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 850/1698] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:40.424536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:40.429319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:40.450644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9c36c-ac36-490d-a8b7-1ef7fb5c4be6 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:40.458631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.459377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.459658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.460008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] PATH_INFO: `/v3/projects/718d27e0fd094dd38f085bcd8d6114e3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.461603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718d27e0fd094dd38f085bcd8d6114e3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.463669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.530775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718d27e0fd094dd38f085bcd8d6114e3', 'request_id': 'req-bc0cfd83-18bb-4461-926e-e49c31ce12b6'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:40.544244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718d27e0fd094dd38f085bcd8d6114e3', 'request_id': 'req-bc0cfd83-18bb-4461-926e-e49c31ce12b6'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:40.552530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 849/1699] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:49:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:49:40.553887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6fa26-fcca-44b3-88c9-d862b11bc246 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:40.570262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6fa26-fcca-44b3-88c9-d862b11bc246 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:40.579513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718d27e0fd094dd38f085bcd8d6114e3', 'request_id': 'req-bc0cfd83-18bb-4461-926e-e49c31ce12b6'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:40.595163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] The token cache is being invalidate because project 718d27e0fd094dd38f085bcd8d6114e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:49:40.595476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:40.596144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:40.599247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 851/1700] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:49:40 2022] DELETE /identity/v3/projects/718d27e0fd094dd38f085bcd8d6114e3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:40.600175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:40.602009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:40.602941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:40.713727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.714431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.714707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.715023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.715734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.719227 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.728171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cfd83-18bb-4461-926e-e49c31ce12b6 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:40.737348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.737987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.738267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.741434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.747117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:40.748665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 850/1701] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:40.751648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:40.756701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:40.769631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.772406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.777809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:40.785668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 852/1702] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:40.790613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853ac3-6384-4801-9d78-035afdc50c5a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:40.790995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:40.793718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:40.812819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.814304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.814621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.815589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d11d-c7b9-4fd6-bc10-70b649c3355c service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:40.816641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] PATH_INFO: `/v3/users/2061a1844c414bdb8d0af0d747a8b3fd` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.819032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2061a1844c414bdb8d0af0d747a8b3fd)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.822320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591880a2-fdea-4af7-86c4-a67833b8deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:40.823145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591880a2-fdea-4af7-86c4-a67833b8deee admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.823428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591880a2-fdea-4af7-86c4-a67833b8deee admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.823699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591880a2-fdea-4af7-86c4-a67833b8deee admin admin] PATH_INFO: `/v3/projects/acfb90415bfe43dab5133c213a9a0905/users/50415fd28af54a938a92b5d71b7a17e3/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.826866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.847612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591880a2-fdea-4af7-86c4-a67833b8deee admin admin] RBAC: Authorizing `identity:create_grant(project_id=acfb90415bfe43dab5133c213a9a0905, user_id=50415fd28af54a938a92b5d71b7a17e3, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:40.850792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591880a2-fdea-4af7-86c4-a67833b8deee admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:40.872337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 853/1703] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:40 2022] PUT /identity/v3/projects/acfb90415bfe43dab5133c213a9a0905/users/50415fd28af54a938a92b5d71b7a17e3/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:40.886362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:40.886362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:40.886362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:40.930640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] MFA Rules not processed for user `50415fd28af54a938a92b5d71b7a17e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:40.931889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:40.951187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2061a1844c414bdb8d0af0d747a8b3fd'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:40.954578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2061a1844c414bdb8d0af0d747a8b3fd'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:40.974253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2061a1844c414bdb8d0af0d747a8b3fd'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.015727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2061a1844c414bdb8d0af0d747a8b3fd'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.017239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2061a1844c414bdb8d0af0d747a8b3fd'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.053433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 851/1704] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:40 2022] DELETE /identity/v3/users/2061a1844c414bdb8d0af0d747a8b3fd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:41.060394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:41.061912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:41.086525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 854/1705] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:41.088101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:41.092452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:41.209997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b040747-abe0-485b-bce3-26a8197417f7 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:41.308613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a708c5-9849-4da4-b5cb-1f5518c5662e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:41.322066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:41.324923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:41.325453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:41.326933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] PATH_INFO: `/v3/projects/cf73661dc0e2415385485014aa8dc32b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:41.330384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf73661dc0e2415385485014aa8dc32b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:41.337101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:41.359215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:41.359915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:41.360249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:41.360526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:41.361683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:41.367960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:41.428383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:41.443107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 855/1706] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:41 2022] POST /identity/v3/projects => generated 385 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:41.456313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:41.479787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:41.513642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf73661dc0e2415385485014aa8dc32b', 'request_id': 'req-6d5867a4-9e07-48f9-82a1-4582d7f915c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.526232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf73661dc0e2415385485014aa8dc32b', 'request_id': 'req-6d5867a4-9e07-48f9-82a1-4582d7f915c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.557939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf73661dc0e2415385485014aa8dc32b', 'request_id': 'req-6d5867a4-9e07-48f9-82a1-4582d7f915c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.593267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] The token cache is being invalidate because project cf73661dc0e2415385485014aa8dc32b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:49:41.594092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.597821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d5867a4-9e07-48f9-82a1-4582d7f915c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:41.605684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 852/1707] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:49:41 2022] DELETE /identity/v3/projects/cf73661dc0e2415385485014aa8dc32b => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:49:41.607198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ae84-fbfc-49fa-9a79-80c75d04192d None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:41.607558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ae84-fbfc-49fa-9a79-80c75d04192d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:41.607944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ae84-fbfc-49fa-9a79-80c75d04192d None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:41.609434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 853/1708] 10.222.0.13 () {54 vars in 912 bytes} [Sat Sep 3 03:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:49:41.612820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87c702-063f-48b4-8176-3824f1137299 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:41.615897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87c702-063f-48b4-8176-3824f1137299 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:41.617152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87c702-063f-48b4-8176-3824f1137299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:41.661501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7f87c702-063f-48b4-8176-3824f1137299 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:41.663012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7f87c702-063f-48b4-8176-3824f1137299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:41.729015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9774e-895a-4e08-9fd7-1fe2eecf36c1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:41.853359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:41.854299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:41.854585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:41.854856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:41.856521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:41.859709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:41.870489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 854/1709] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:41.872008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f244-ffa8-4285-9f26-1f0736f0a450 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:41.872301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f244-ffa8-4285-9f26-1f0736f0a450 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:41.872577 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f244-ffa8-4285-9f26-1f0736f0a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:41.910101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 856/1710] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:41 2022] POST /identity/v3/users => generated 299 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:41.914597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:41.916750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:41.926719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f3f1f244-ffa8-4285-9f26-1f0736f0a450 None None] MFA Rules not processed for user `c1a7ee9f78da46e4abe27eadb2d17b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:41.928010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f3f1f244-ffa8-4285-9f26-1f0736f0a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:42.039298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e9476-620e-42b6-874f-43c049b0a753 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.049249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.049839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.050137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.050407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.056035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:42.085121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.089868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.099813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 855/1711] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:49:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:42.101171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff540ae9-91a1-4ab5-8407-4af1f22cafeb None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.102032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff540ae9-91a1-4ab5-8407-4af1f22cafeb None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.102418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff540ae9-91a1-4ab5-8407-4af1f22cafeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.119270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 857/1712] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:42.121145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.125258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:42.147498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ff540ae9-91a1-4ab5-8407-4af1f22cafeb None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:42.153650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ff540ae9-91a1-4ab5-8407-4af1f22cafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:42.158038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4c67-3780-4ca9-8d25-7d972a4e7c3b service placement] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.176454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 856/1713] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:42.177873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff540ae9-91a1-4ab5-8407-4af1f22cafeb None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.179342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.181186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.181577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.182865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.189776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.198032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff540ae9-91a1-4ab5-8407-4af1f22cafeb None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.203558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.219674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.220617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.220617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.221068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.221736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:42.222036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.223654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.237278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 858/1714] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:42.239666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.257194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 857/1715] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:42.259028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.287204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407118b2-38d1-4e4f-a8dc-e77f9d7c1786 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.289888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1525c22-f19f-4075-9ed2-15eaa6e99b01 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.297780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.299180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.301145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.301436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] PATH_INFO: `/v3/projects/054b77c48a674d31a2d2144aee6ee878/users/e3ff935dafc144809b332c458d2278b4/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.306373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.311771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.312051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.312384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.313070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.319908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.326130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:42.337637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=054b77c48a674d31a2d2144aee6ee878, user_id=e3ff935dafc144809b332c458d2278b4, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.341229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.373423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 859/1716] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:42 2022] PUT /identity/v3/projects/054b77c48a674d31a2d2144aee6ee878/users/e3ff935dafc144809b332c458d2278b4/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:42.374534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.380018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:42.394436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 858/1717] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:42 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:42.395469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.489125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:42.573589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eec79e-6210-4a6b-ada5-e82ce63f15df admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.573983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25908e31-f0af-4eec-a10c-e79e5bc0c85c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.593094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.594188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.594505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.594781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.601788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.610795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.639734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 859/1718] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:42.640725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.655612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:42.679343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.680360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.680836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.681257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.698274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcffe91-c8b8-4716-802a-8cda9939b1f8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.714072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.715877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.728906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.729553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.729901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.730250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] PATH_INFO: `/v3/projects/28915f3d2ea140719b114ffe73c50bbb` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.731968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28915f3d2ea140719b114ffe73c50bbb)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.735650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 860/1719] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:42.736308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.737405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.762687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5a7f-2b08-494f-a6e1-c205cfb535c8 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.770237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:42.771493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:42.771907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:42.772287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:42.773203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:42.777296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:42.883063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 861/1720] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:42 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:42.887243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.895039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28915f3d2ea140719b114ffe73c50bbb', 'request_id': 'req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:42.908942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28915f3d2ea140719b114ffe73c50bbb', 'request_id': 'req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:42.921489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28915f3d2ea140719b114ffe73c50bbb', 'request_id': 'req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:42.942290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e850e61-2374-44a3-b37e-312ab563a6fc admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:42.963142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] The token cache is being invalidate because project 28915f3d2ea140719b114ffe73c50bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:49:42.973107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:42.974763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:42.976760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 860/1721] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:49:42 2022] DELETE /identity/v3/projects/28915f3d2ea140719b114ffe73c50bbb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:42.981378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:42.984277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:43.166713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448904a6-5b03-4ce2-ae85-eebdcbf6d983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:43.169324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448904a6-5b03-4ce2-ae85-eebdcbf6d983 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.170404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448904a6-5b03-4ce2-ae85-eebdcbf6d983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.171926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448904a6-5b03-4ce2-ae85-eebdcbf6d983 admin admin] PATH_INFO: `/v3/projects/054b77c48a674d31a2d2144aee6ee878/users/e3ff935dafc144809b332c458d2278b4/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.177146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448904a6-5b03-4ce2-ae85-eebdcbf6d983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054b77c48a674d31a2d2144aee6ee878, user_id=e3ff935dafc144809b332c458d2278b4, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:43.184099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448904a6-5b03-4ce2-ae85-eebdcbf6d983 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:43.210940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d2f2e-f7aa-4114-ad73-39ccd9b15ad5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:43.215111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 862/1722] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:42 2022] PUT /identity/v3/projects/054b77c48a674d31a2d2144aee6ee878/users/e3ff935dafc144809b332c458d2278b4/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:43.217702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882082-faf8-4a7d-a3f3-bbc54c91fa2c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.219365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882082-faf8-4a7d-a3f3-bbc54c91fa2c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.220198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882082-faf8-4a7d-a3f3-bbc54c91fa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.275125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-08882082-faf8-4a7d-a3f3-bbc54c91fa2c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:43.278571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-08882082-faf8-4a7d-a3f3-bbc54c91fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:43.325082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:43.343323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:43.359315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc06501-d0ad-4491-a28d-8813b90ec4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:43.361471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06501-d0ad-4491-a28d-8813b90ec4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.362194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06501-d0ad-4491-a28d-8813b90ec4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.365075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06501-d0ad-4491-a28d-8813b90ec4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.366606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc06501-d0ad-4491-a28d-8813b90ec4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:43.371374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc06501-d0ad-4491-a28d-8813b90ec4e8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:43.401318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 861/1723] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:43.402999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283019-9ef8-45ef-bb3b-e56a739ad253 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.403396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283019-9ef8-45ef-bb3b-e56a739ad253 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.403781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27283019-9ef8-45ef-bb3b-e56a739ad253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.469365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 863/1724] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:43.470261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882082-faf8-4a7d-a3f3-bbc54c91fa2c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:43.491890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882082-faf8-4a7d-a3f3-bbc54c91fa2c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:43.492998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-27283019-9ef8-45ef-bb3b-e56a739ad253 None None] MFA Rules not processed for user `e3ff935dafc144809b332c458d2278b4`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:43.494597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-27283019-9ef8-45ef-bb3b-e56a739ad253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:43.501946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f455d5-0b4b-46cc-824c-24040f1d013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:43.502582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f455d5-0b4b-46cc-824c-24040f1d013a admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.502880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f455d5-0b4b-46cc-824c-24040f1d013a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.503159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f455d5-0b4b-46cc-824c-24040f1d013a admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.503908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f455d5-0b4b-46cc-824c-24040f1d013a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:43.505582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f455d5-0b4b-46cc-824c-24040f1d013a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:43.557370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 864/1725] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:43.562656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112bab-8b7e-48e4-98a2-47694d21de71 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.563110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112bab-8b7e-48e4-98a2-47694d21de71 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.565028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112bab-8b7e-48e4-98a2-47694d21de71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.627355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-5b112bab-8b7e-48e4-98a2-47694d21de71 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:43.631200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5b112bab-8b7e-48e4-98a2-47694d21de71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:43.655508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 865/1726] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:43.659724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112bab-8b7e-48e4-98a2-47694d21de71 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:43.740868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112bab-8b7e-48e4-98a2-47694d21de71 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:43.779540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:43.780262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.780545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.780817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] PATH_INFO: `/v3/projects/06ac3638ee1d48d796da026b4ed3853a/users/5a7da3802f6042598463f953831db6f3/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.782605 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 862/1727] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:43.797658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27283019-9ef8-45ef-bb3b-e56a739ad253 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:43.831008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27283019-9ef8-45ef-bb3b-e56a739ad253 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:43.846840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ac3638ee1d48d796da026b4ed3853a, user_id=5a7da3802f6042598463f953831db6f3, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:43.854017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a567-74c8-4534-871f-2b6cf5ac8549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:43.854804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a567-74c8-4534-871f-2b6cf5ac8549 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.855090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a567-74c8-4534-871f-2b6cf5ac8549 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.855362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a567-74c8-4534-871f-2b6cf5ac8549 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.855984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:43.857207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a567-74c8-4534-871f-2b6cf5ac8549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:49:43.857831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a567-74c8-4534-871f-2b6cf5ac8549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:43.865216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a567-74c8-4534-871f-2b6cf5ac8549 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:43.893658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 866/1728] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:43 2022] PUT /identity/v3/projects/06ac3638ee1d48d796da026b4ed3853a/users/5a7da3802f6042598463f953831db6f3/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:43.897762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:43.907161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 863/1729] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:49:43.909118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:43.915878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ae088-c757-4736-813d-2443d30c608d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:43.916172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ae088-c757-4736-813d-2443d30c608d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:43.916709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ae088-c757-4736-813d-2443d30c608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:43.995697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-506ae088-c757-4736-813d-2443d30c608d None None] MFA Rules not processed for user `5a7da3802f6042598463f953831db6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:43.998433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-506ae088-c757-4736-813d-2443d30c608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:44.041939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699acd87-dec7-4bde-8add-ec06e03f5d3b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:44.049365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:44.050024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:44.050308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:44.050586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:44.197576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:44.199070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:44.243396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 864/1730] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:44.246522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ae088-c757-4736-813d-2443d30c608d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:44.249391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 867/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:44.252748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:44.419861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:44.451430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:44.459611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ae088-c757-4736-813d-2443d30c608d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:44.465829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965e37-a9af-400b-91cb-df120ff1fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:44.466619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965e37-a9af-400b-91cb-df120ff1fe4b admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:44.467185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965e37-a9af-400b-91cb-df120ff1fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:44.467593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965e37-a9af-400b-91cb-df120ff1fe4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:44.468466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965e37-a9af-400b-91cb-df120ff1fe4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:44.471182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85965e37-a9af-400b-91cb-df120ff1fe4b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:44.524950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 865/1732] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:44 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:44.526598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6c459-686a-49f5-8276-6fb950e8b9ba None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:44.526936 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6c459-686a-49f5-8276-6fb950e8b9ba None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:44.527135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6c459-686a-49f5-8276-6fb950e8b9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:44.617071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-75a6c459-686a-49f5-8276-6fb950e8b9ba None None] MFA Rules not processed for user `44a51adff4c546da9c7f476e58e2fc88`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:44.620206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-75a6c459-686a-49f5-8276-6fb950e8b9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:44.677998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9d88-6c17-425a-9d72-613c1e5fffb9 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:44.961049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 866/1733] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:44.966357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6c459-686a-49f5-8276-6fb950e8b9ba None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:45.094617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:45.099727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:45.099845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:45.100127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:45.108026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:45.143551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:45.320070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 868/1734] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:44 2022] POST /identity/v3/projects => generated 363 bytes in 1070 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:45.322672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:45.324772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6c459-686a-49f5-8276-6fb950e8b9ba None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:45.635769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:45.636482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:45.636749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:45.636986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:45.637647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:45.659704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:45.665469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b465-c1fd-4a70-8cc6-a306a0ac412c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:45.700998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:45.701634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:45.701850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:45.703091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:45.703091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:45.705194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:45.741750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 867/1735] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:44 2022] POST /identity/v3/users => generated 289 bytes in 774 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:45.744315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:45.788890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 869/1736] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:45 2022] POST /identity/v3/users => generated 288 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:45.790585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:45.792714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b11455-e666-4115-896a-d0c8775dabf1 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:45.815154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:45.815818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:45.816101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:45.834829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:45.837700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:45.839417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:45.847144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7cc71-dbe9-4a89-b2e0-e9b1051d2e46 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:45.874127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16402d-39d8-4e0f-af0c-6b0a504f1af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:45.877294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16402d-39d8-4e0f-af0c-6b0a504f1af8 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:45.877591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16402d-39d8-4e0f-af0c-6b0a504f1af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:45.877865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16402d-39d8-4e0f-af0c-6b0a504f1af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:45.878547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16402d-39d8-4e0f-af0c-6b0a504f1af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:45.886595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 868/1737] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:45.887030 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16402d-39d8-4e0f-af0c-6b0a504f1af8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:45.902718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:45.926466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65815e36-da91-4c64-b7d1-f963da9efb35 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:45.961342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:45.966001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 870/1738] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:45.973547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67388-8645-45e6-b895-619f1ea6017e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:45.977456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67388-8645-45e6-b895-619f1ea6017e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:45.978353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:45.979051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:45.979330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:45.980040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:45.980261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a67388-8645-45e6-b895-619f1ea6017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:45.996810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:46.026783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:46.067581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 869/1739] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:46.068584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:46.117943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a7229-d394-4ddc-a872-235c9daecf14 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:46.150998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:46.152293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:46.153417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:46.154429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] PATH_INFO: `/v3/projects/48ede11f92a64a599db7bb1f43c74976/users/9c274a931576463b8cfd4b90ad02677e/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:46.213527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ede11f92a64a599db7bb1f43c74976, user_id=9c274a931576463b8cfd4b90ad02677e, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:46.230279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:46.266130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c6a67388-8645-45e6-b895-619f1ea6017e None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:46.267378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c6a67388-8645-45e6-b895-619f1ea6017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:46.290530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 870/1740] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:46 2022] PUT /identity/v3/projects/48ede11f92a64a599db7bb1f43c74976/users/9c274a931576463b8cfd4b90ad02677e/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:46.292027 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:46.338910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:46.518888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b794-a90a-414f-a880-fcc49b99f706 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:46.525701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 871/1741] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:49:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:46.527835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:46.528907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:46.529396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:46.530112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] PATH_INFO: `/v3/projects/e2b923a6404d4deeb8f69c8b05a2d82b/users/3f699023c4244a41b4f0222bdaa28ed9/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:46.538449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a67388-8645-45e6-b895-619f1ea6017e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:46.559852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b923a6404d4deeb8f69c8b05a2d82b, user_id=3f699023c4244a41b4f0222bdaa28ed9, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:46.564118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a67388-8645-45e6-b895-619f1ea6017e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:46.564284 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:46.588018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89da93-eb54-4e66-827e-b7c4bc39cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:46.588713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89da93-eb54-4e66-827e-b7c4bc39cf8a admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:46.589050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89da93-eb54-4e66-827e-b7c4bc39cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:46.589323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89da93-eb54-4e66-827e-b7c4bc39cf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:46.589975 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89da93-eb54-4e66-827e-b7c4bc39cf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:46.591747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89da93-eb54-4e66-827e-b7c4bc39cf8a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:46.604391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 871/1742] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:46 2022] PUT /identity/v3/projects/e2b923a6404d4deeb8f69c8b05a2d82b/users/3f699023c4244a41b4f0222bdaa28ed9/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:46.605526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:46.607348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:46.624988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 872/1743] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:46.624988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8cf1-9a7b-4730-b9e6-63ecffa72ec8 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:46.624988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8cf1-9a7b-4730-b9e6-63ecffa72ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:46.624988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8cf1-9a7b-4730-b9e6-63ecffa72ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:46.688702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72994fb-8fa1-4937-91a5-70b0d0147560 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:46.693014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:46.693743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:46.694030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:46.695100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:46.697384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:46.705578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0dae8cf1-9a7b-4730-b9e6-63ecffa72ec8 None None] MFA Rules not processed for user `3f699023c4244a41b4f0222bdaa28ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:46.706825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0dae8cf1-9a7b-4730-b9e6-63ecffa72ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:46.860635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 873/1744] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:46.862429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae8cf1-9a7b-4730-b9e6-63ecffa72ec8 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:46.884776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:46.889129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:46.913164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 872/1745] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:46.914044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:46.915603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:46.955777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:46.999101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae8cf1-9a7b-4730-b9e6-63ecffa72ec8 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:47.014267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:47.015255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:47.015821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:47.016283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] PATH_INFO: `/v3/projects/48ede11f92a64a599db7bb1f43c74976/users/9c274a931576463b8cfd4b90ad02677e/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:47.021022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ede11f92a64a599db7bb1f43c74976, user_id=9c274a931576463b8cfd4b90ad02677e, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:47.025772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:47.045785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbb047-ce24-4523-9477-0f7acfc55856 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:47.057642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 874/1746] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:46 2022] PUT /identity/v3/projects/48ede11f92a64a599db7bb1f43c74976/users/9c274a931576463b8cfd4b90ad02677e/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:47.059887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:47.135381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:47.182009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e94c7d-8a76-42f0-abe8-6b5636dfff7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:47.183623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94c7d-8a76-42f0-abe8-6b5636dfff7e service swift] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:47.184636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94c7d-8a76-42f0-abe8-6b5636dfff7e service swift] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:47.185057 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94c7d-8a76-42f0-abe8-6b5636dfff7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:47.204867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbd8da-5932-4907-a7f9-f0e5ec7defdd admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:47.220011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199a177-4525-4fa4-84ba-dc3002d3b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:47.220649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a177-4525-4fa4-84ba-dc3002d3b6ca admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:47.220949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a177-4525-4fa4-84ba-dc3002d3b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:47.221234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199a177-4525-4fa4-84ba-dc3002d3b6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:47.222079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199a177-4525-4fa4-84ba-dc3002d3b6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:47.225393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199a177-4525-4fa4-84ba-dc3002d3b6ca admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:47.278788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 875/1747] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:49:47 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:47.280160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb675-367a-43fa-af71-1bfe24158cac None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:47.280452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb675-367a-43fa-af71-1bfe24158cac None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:47.280749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eb675-367a-43fa-af71-1bfe24158cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:47.323501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e94c7d-8a76-42f0-abe8-6b5636dfff7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:47.327591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e94c7d-8a76-42f0-abe8-6b5636dfff7e service swift] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:47.342577 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 873/1748] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:49:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:49:47.346060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a96eb6-fe23-4468-ad32-4438a933adcc None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:47.346495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a96eb6-fe23-4468-ad32-4438a933adcc None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:47.346967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a96eb6-fe23-4468-ad32-4438a933adcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:47.350506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-6e6eb675-367a-43fa-af71-1bfe24158cac None None] MFA Rules not processed for user `1a3d08bbd8aa4338b905ac912d1319fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:47.351769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6e6eb675-367a-43fa-af71-1bfe24158cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:47.413788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c1a96eb6-fe23-4468-ad32-4438a933adcc None None] MFA Rules not processed for user `9c274a931576463b8cfd4b90ad02677e`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:47.419704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c1a96eb6-fe23-4468-ad32-4438a933adcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:47.618180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 876/1749] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:47.619853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6eb675-367a-43fa-af71-1bfe24158cac None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:47.669047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:47.862276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6eb675-367a-43fa-af71-1bfe24158cac None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:47.874207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:47.875367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:47.875835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:47.876114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:47.876820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:47.878929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:47.905831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 874/1750] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:47.922658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a96eb6-fe23-4468-ad32-4438a933adcc None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:47.959262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 877/1751] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:49:47 2022] POST /identity/v3/users => generated 295 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:49:47.960240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:47.991830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b77b3-9ae2-4712-9027-de4850c35303 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:48.021740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:48.022386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:48.022671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:48.022946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:48.023677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:48.025362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:48.065389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 878/1752] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:48.074321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:48.099536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:48.188037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:48.259853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a96eb6-fe23-4468-ad32-4438a933adcc None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:48.283609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:48.289830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:48.290153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:48.290436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:48.350875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:48.358607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:48.364843 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2525-5f85-43f2-aaed-95491d2a8cc7 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:48.383004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:48.384098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:48.384098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:48.384388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:48.400322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:48.403947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:48.405016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 875/1753] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:48.410794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:48.432925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 879/1754] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:48.477087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f61ea-1ade-483b-94e3-3cf79bcb188a service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:48.496619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:48.497374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:48.497684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:48.498404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] PATH_INFO: `/v3/projects/a1f67a25d3a643ca9ef78d3ac6721cca/users/b8d525557589476e973b3c54c032c9b7/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:48.567998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f67a25d3a643ca9ef78d3ac6721cca, user_id=b8d525557589476e973b3c54c032c9b7, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:48.571093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:48.602506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 876/1755] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:48 2022] PUT /identity/v3/projects/a1f67a25d3a643ca9ef78d3ac6721cca/users/b8d525557589476e973b3c54c032c9b7/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:48.604835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:48.630626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26781f-55ba-45aa-8978-9f991cdff0be service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:48.636776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:48.784930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c551e2-d354-45bc-b055-2f8184bf78e9 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:48.793579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee658af6-5683-4d6b-a0d8-83b3c7f4adc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:48.795176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658af6-5683-4d6b-a0d8-83b3c7f4adc8 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:48.795918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658af6-5683-4d6b-a0d8-83b3c7f4adc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:48.796486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee658af6-5683-4d6b-a0d8-83b3c7f4adc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:48.798935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:48.799628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:48.799916 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:48.800199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:48.801138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:48.802864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:48.839870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 880/1756] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:49:48.844528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:48.892642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a49a3-afa6-4b9c-81c6-0af2d9c17088 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:48.927965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88239bc-7773-40ea-ab0f-d266babe01f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:48.930417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88239bc-7773-40ea-ab0f-d266babe01f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:48.932986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88239bc-7773-40ea-ab0f-d266babe01f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:48.942342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88239bc-7773-40ea-ab0f-d266babe01f8 admin admin] PATH_INFO: `/v3/projects/a1f67a25d3a643ca9ef78d3ac6721cca/users/b8d525557589476e973b3c54c032c9b7/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:48.978194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88239bc-7773-40ea-ab0f-d266babe01f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f67a25d3a643ca9ef78d3ac6721cca, user_id=b8d525557589476e973b3c54c032c9b7, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:48.991568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88239bc-7773-40ea-ab0f-d266babe01f8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:49.021785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:49.040151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658af6-5683-4d6b-a0d8-83b3c7f4adc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:49.046521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee658af6-5683-4d6b-a0d8-83b3c7f4adc8 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:49.078823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 881/1757] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:49:48 2022] PUT /identity/v3/projects/a1f67a25d3a643ca9ef78d3ac6721cca/users/b8d525557589476e973b3c54c032c9b7/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:49.083097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36842-3cc3-4f94-b69b-ed4dff6bf2a8 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:49.085747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36842-3cc3-4f94-b69b-ed4dff6bf2a8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:49.088532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c36842-3cc3-4f94-b69b-ed4dff6bf2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:49.113377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 877/1758] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:49:49.150739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16829155-181a-4573-b256-801c4a3df14b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:49.155649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16829155-181a-4573-b256-801c4a3df14b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:49.156065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16829155-181a-4573-b256-801c4a3df14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:49.181181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-27c36842-3cc3-4f94-b69b-ed4dff6bf2a8 None None] MFA Rules not processed for user `e41cfa8ce3a847738325ef2952b41e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:49.186099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-27c36842-3cc3-4f94-b69b-ed4dff6bf2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:49.313862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-16829155-181a-4573-b256-801c4a3df14b None None] MFA Rules not processed for user `b8d525557589476e973b3c54c032c9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:49.313862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-16829155-181a-4573-b256-801c4a3df14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:49.578166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 878/1759] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:49.581048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:49.603064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:49.603064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:49.617372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 882/1760] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 538 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:49.725561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] MFA Rules not processed for user `c1a7ee9f78da46e4abe27eadb2d17b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:49.726958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:49.870550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c36842-3cc3-4f94-b69b-ed4dff6bf2a8 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:50.004570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 879/1761] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Sep 3 03:49:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:50.051495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:50.069257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:50.071615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:50.096175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904fa79-4526-475c-bfb8-df1463732062 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:50.117941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:50.118903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:50.119319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:50.119744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:50.120347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c36842-3cc3-4f94-b69b-ed4dff6bf2a8 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:50.137652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:50.138414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:50.139446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:50.139551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:50.156849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:50.172180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:50.229806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 880/1762] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:49:50.496127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:50.497869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:50.523304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 883/1763] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:49:53.271812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:53.286343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56480e9-4fcc-456e-9afc-45efd176170e service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:53.293236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:53.294358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:53.295588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:53.296050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:53.298403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:53.523296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:53.528793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:53.570298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 881/1764] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:54.440168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:54.456231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:54.470628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3058-0bcd-4af1-9a39-403c56399897 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:54.495279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd6369-e1d0-4e96-a468-b60005691c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:54.501570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd6369-e1d0-4e96-a468-b60005691c10 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:54.502638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd6369-e1d0-4e96-a468-b60005691c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:54.502943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd6369-e1d0-4e96-a468-b60005691c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:54.567012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd6369-e1d0-4e96-a468-b60005691c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:54.575075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd6369-e1d0-4e96-a468-b60005691c10 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:54.625146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 882/1765] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:54.779509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c259b-8b5e-47ea-aef8-64c7fb50b6d7 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:54.814005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:54.817980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:54.818355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:54.822705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] PATH_INFO: `/v3/users/5a7da3802f6042598463f953831db6f3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:54.835676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7da3802f6042598463f953831db6f3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:54.839353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:54.907450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7a5e-5bf9-438b-ab5a-8d307a1fdc23 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:54.908368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7a5e-5bf9-438b-ab5a-8d307a1fdc23 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:54.908664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c7a5e-5bf9-438b-ab5a-8d307a1fdc23 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:54.910578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 883/1766] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:49:54.957688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4ac7-f885-42a8-9b7c-24f24b9d0465 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:54.958066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4ac7-f885-42a8-9b7c-24f24b9d0465 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:54.958590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa4ac7-f885-42a8-9b7c-24f24b9d0465 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:54.962053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 884/1767] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:49:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:49:55.042835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7da3802f6042598463f953831db6f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:55.057936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7da3802f6042598463f953831db6f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:55.104299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7da3802f6042598463f953831db6f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:55.107905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7da3802f6042598463f953831db6f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:55.135461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03cfa-680f-4335-b24b-fafea9f6be52 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:55.135877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03cfa-680f-4335-b24b-fafea9f6be52 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:55.136690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd03cfa-680f-4335-b24b-fafea9f6be52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:55.163061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:55.188208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7548bfa2-fdb2-4394-a881-e15d4cca6a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7da3802f6042598463f953831db6f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:55.239185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5cd03cfa-680f-4335-b24b-fafea9f6be52 None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:55.245878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 884/1768] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:54 2022] DELETE /identity/v3/users/5a7da3802f6042598463f953831db6f3 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:55.246107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5cd03cfa-680f-4335-b24b-fafea9f6be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:55.248812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:55.249623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:55.249943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:55.343623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:55.347473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:55.362176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:55.568638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 885/1769] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:49:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:55.569942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc3e6-16dc-4c23-9d73-d2d09984db84 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:55.571070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc3e6-16dc-4c23-9d73-d2d09984db84 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:55.572061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bc3e6-16dc-4c23-9d73-d2d09984db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:55.622811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 885/1770] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:49:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:55.634380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-158bc3e6-16dc-4c23-9d73-d2d09984db84 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:55.637260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-158bc3e6-16dc-4c23-9d73-d2d09984db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:55.803564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 886/1771] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:55.826207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:55.826207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:55.896296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6dae3-1493-49db-b599-414377cf8af8 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:55.939958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:55.941015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:55.945900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:55.948822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:55.974263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:55.978382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:55.998654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 886/1772] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:56.234718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bc3e6-16dc-4c23-9d73-d2d09984db84 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:56.283747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bc3e6-16dc-4c23-9d73-d2d09984db84 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:56.293288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:56.294971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:56.308355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:56.313931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:56.314354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:56.316536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:56.362355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:56.366054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:56.403100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 887/1773] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:56.470463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bd4d-cd0d-41fd-ba56-bd048056e88e service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:56.504414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531874b0-848d-4b64-812f-69215428ebab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:56.509827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531874b0-848d-4b64-812f-69215428ebab service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:56.510192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531874b0-848d-4b64-812f-69215428ebab service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:56.511846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531874b0-848d-4b64-812f-69215428ebab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:56.557241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531874b0-848d-4b64-812f-69215428ebab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:56.562622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531874b0-848d-4b64-812f-69215428ebab service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:56.613471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 887/1774] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:49:57.964046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:57.968075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:57.998873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19eacf-8fde-43d7-b7f1-f40e86a0b51b service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:58.027499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:58.030097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:58.030738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:58.030738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] PATH_INFO: `/v3/users/d7646c10b9ef4c52add9de5f7993f8d4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:58.036866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7646c10b9ef4c52add9de5f7993f8d4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:58.038823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:58.293331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7646c10b9ef4c52add9de5f7993f8d4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:58.294317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7646c10b9ef4c52add9de5f7993f8d4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:58.309677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7646c10b9ef4c52add9de5f7993f8d4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:58.323462 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7646c10b9ef4c52add9de5f7993f8d4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:58.324356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7646c10b9ef4c52add9de5f7993f8d4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:58.349693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:58.367690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 888/1775] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:57 2022] DELETE /identity/v3/users/d7646c10b9ef4c52add9de5f7993f8d4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:58.372410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:58.373004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:58.373098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:58.456315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:49:58.459365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:58.643997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:58.648412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:58.695604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 888/1776] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:49:58.713609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:58.714755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:49:58.806127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:49:58.866823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b5be6-7d45-457e-bb12-6e430bc72123 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:58.879416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:58.880171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:58.880360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac6759-92e7-4feb-b4ba-19046faf2601 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:58.880569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:58.880702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] PATH_INFO: `/v3/projects/06ac3638ee1d48d796da026b4ed3853a` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:58.884289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ac3638ee1d48d796da026b4ed3853a)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:58.886293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:58.890266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:58.892493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:58.892493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:58.892886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:58.924819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:58.932141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:58.971813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 889/1777] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:49:59.069883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ac3638ee1d48d796da026b4ed3853a', 'request_id': 'req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.102222 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ac3638ee1d48d796da026b4ed3853a', 'request_id': 'req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.138417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ac3638ee1d48d796da026b4ed3853a', 'request_id': 'req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.199897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] The token cache is being invalidate because project 06ac3638ee1d48d796da026b4ed3853a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:49:59.200549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.204191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.216039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 889/1778] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:49:58 2022] DELETE /identity/v3/projects/06ac3638ee1d48d796da026b4ed3853a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:49:59.220830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:49:59.232876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af098c4f-7d6e-4ece-b842-de071c29fa8e service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:49:59.493061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:49:59.493061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:49:59.493061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:49:59.493061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] PATH_INFO: `/v3/users/9c274a931576463b8cfd4b90ad02677e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:49:59.501888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c274a931576463b8cfd4b90ad02677e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:49:59.509395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:49:59.653207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c274a931576463b8cfd4b90ad02677e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.655480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c274a931576463b8cfd4b90ad02677e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.680560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c274a931576463b8cfd4b90ad02677e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.681809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c274a931576463b8cfd4b90ad02677e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.718261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c274a931576463b8cfd4b90ad02677e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:49:59.764418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 890/1779] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:49:59 2022] DELETE /identity/v3/users/9c274a931576463b8cfd4b90ad02677e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:01.091291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:01.092872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:01.122101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ac2b2-3202-4c2d-8a46-8b5a1c1dcd9e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:01.193874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:01.196590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:01.350879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:01.354014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:01.354430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:01.354768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] PATH_INFO: `/v3/projects/8e21789e89894aa9b569aae68b2d22c6` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:01.359178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e21789e89894aa9b569aae68b2d22c6)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:01.362136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:01.382277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:01.421740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0a2ef-8789-4ca4-b824-6fbfeec9c955 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:01.439509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:01.440728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:01.443054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:01.443553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] PATH_INFO: `/v3/projects/48ede11f92a64a599db7bb1f43c74976` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:01.448725 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ede11f92a64a599db7bb1f43c74976)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:01.455891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:01.469724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:01.538581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e21789e89894aa9b569aae68b2d22c6', 'request_id': 'req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.557975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e21789e89894aa9b569aae68b2d22c6', 'request_id': 'req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.576197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e21789e89894aa9b569aae68b2d22c6', 'request_id': 'req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.597727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ede11f92a64a599db7bb1f43c74976', 'request_id': 'req-343584f5-4efc-40a6-a26a-8a2cff205510'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.610031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] The token cache is being invalidate because project 8e21789e89894aa9b569aae68b2d22c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:01.610031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.614631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ede11f92a64a599db7bb1f43c74976', 'request_id': 'req-343584f5-4efc-40a6-a26a-8a2cff205510'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.616516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9ebb4aa0-2310-4b74-bf1f-01ebecc80d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.619295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 890/1780] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:01 2022] DELETE /identity/v3/projects/8e21789e89894aa9b569aae68b2d22c6 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:01.621039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaac822-e35e-4643-8e7f-a5556f3576c2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:01.621329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaac822-e35e-4643-8e7f-a5556f3576c2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:01.621603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaac822-e35e-4643-8e7f-a5556f3576c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:01.635098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ede11f92a64a599db7bb1f43c74976', 'request_id': 'req-343584f5-4efc-40a6-a26a-8a2cff205510'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.660243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] The token cache is being invalidate because project 48ede11f92a64a599db7bb1f43c74976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:01.660607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.661370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:01.666557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 891/1781] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:01 2022] DELETE /identity/v3/projects/48ede11f92a64a599db7bb1f43c74976 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:01.666557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:01.666557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:01.671937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-efaac822-e35e-4643-8e7f-a5556f3576c2 None None] MFA Rules not processed for user `1a3d08bbd8aa4338b905ac912d1319fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:01.673128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-efaac822-e35e-4643-8e7f-a5556f3576c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:01.801338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 891/1782] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:01.801338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5241a0-ee51-4fc0-9980-355c4e9b6331 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:01.801338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5241a0-ee51-4fc0-9980-355c4e9b6331 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:01.801338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5241a0-ee51-4fc0-9980-355c4e9b6331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:01.850291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343584f5-4efc-40a6-a26a-8a2cff205510 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:01.859919 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ca5241a0-ee51-4fc0-9980-355c4e9b6331 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:01.862220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ca5241a0-ee51-4fc0-9980-355c4e9b6331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:01.868754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:01.869628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:01.870382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:01.872477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] PATH_INFO: `/v3/users/50415fd28af54a938a92b5d71b7a17e3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:01.872789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 892/1783] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:01.880202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50415fd28af54a938a92b5d71b7a17e3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:01.882613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:01.889564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a60065-41d3-4c2a-9467-60d3f05461ef None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:01.889927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a60065-41d3-4c2a-9467-60d3f05461ef None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:01.890167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a60065-41d3-4c2a-9467-60d3f05461ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:01.975113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c0a60065-41d3-4c2a-9467-60d3f05461ef None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:01.976388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c0a60065-41d3-4c2a-9467-60d3f05461ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:02.002697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50415fd28af54a938a92b5d71b7a17e3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:02.003447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50415fd28af54a938a92b5d71b7a17e3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:02.006480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 893/1784] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:02.009095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a60065-41d3-4c2a-9467-60d3f05461ef None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.022762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50415fd28af54a938a92b5d71b7a17e3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:02.023543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50415fd28af54a938a92b5d71b7a17e3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:02.034648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a60065-41d3-4c2a-9467-60d3f05461ef None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:02.045025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50415fd28af54a938a92b5d71b7a17e3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:02.047770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:02.047770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.048034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.048295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.052005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:02.052395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:02.054316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:02.088239 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 892/1785] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:01 2022] DELETE /identity/v3/users/50415fd28af54a938a92b5d71b7a17e3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:02.097601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 894/1786] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:02.104534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.107275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:02.117386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:02.232635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cbab8-ebf7-4cfe-9d2f-f696e59a3c75 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:02.245871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:02.247709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.248008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.248295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.251245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:02.258208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:02.335655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 893/1787] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:02 2022] POST /identity/v3/projects => generated 409 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:02.336069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.348201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c07ed-a74c-46e7-aa03-5fe8e7541a80 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:02.504196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:02.506665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.507292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.507836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.509241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:02.512780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:02.543377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 895/1788] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:02 2022] POST /identity/v3/users => generated 305 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:02.547865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.559584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088591-3d2a-4024-af13-2a8614d04992 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:02.565029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:02.565811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.566166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.566515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.567262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:02.569003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:02.581631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 894/1789] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:02.586623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.598579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eee38-c564-456c-a558-4bd1d617b966 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:02.603649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986450f-44fb-49f9-a077-819a9ddaa288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:02.604969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986450f-44fb-49f9-a077-819a9ddaa288 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.604969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986450f-44fb-49f9-a077-819a9ddaa288 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.604969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986450f-44fb-49f9-a077-819a9ddaa288 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.605545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986450f-44fb-49f9-a077-819a9ddaa288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:02.607146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986450f-44fb-49f9-a077-819a9ddaa288 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:02.619615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 896/1790] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:02.624820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.637141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367702b1-7005-494f-9b01-6c946f95610f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:02.643040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:02.643485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.643769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.644596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] PATH_INFO: `/v3/projects/483175f7b02e465896a67edd9f5905ce/users/5a8d507fbdd34ee1ae2de64a4d46dc44/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.665284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] RBAC: Authorizing `identity:create_grant(project_id=483175f7b02e465896a67edd9f5905ce, user_id=5a8d507fbdd34ee1ae2de64a4d46dc44, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:02.668137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:02.688521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 895/1791] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:02 2022] PUT /identity/v3/projects/483175f7b02e465896a67edd9f5905ce/users/5a8d507fbdd34ee1ae2de64a4d46dc44/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:02.701012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.701627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.702234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.733104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:02.743775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] MFA Rules not processed for user `5a8d507fbdd34ee1ae2de64a4d46dc44`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:02.745848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:02.835143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.838261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 897/1792] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:02 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:02.967898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa75093-c550-4a82-a273-ed8fd980724e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:02.974693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:02.975385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:02.975717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:02.975999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:02.976782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:02.979673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:02.983510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:02.984836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:03.007644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc055f-ca8f-4a66-9058-c2cffbe56833 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:03.019974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:03.021085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:03.021367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:03.021649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] PATH_INFO: `/v3/projects/acfb90415bfe43dab5133c213a9a0905` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:03.025779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acfb90415bfe43dab5133c213a9a0905)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:03.028420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:03.049177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 896/1793] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:02 2022] POST /identity/v3/projects => generated 407 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:03.054006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:03.138737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:03.153231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acfb90415bfe43dab5133c213a9a0905', 'request_id': 'req-21ac6da2-5dab-4138-bb43-0484a19d7b25'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.172126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b568ad-913c-42d0-9dbd-8609448cd7d3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:03.183935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acfb90415bfe43dab5133c213a9a0905', 'request_id': 'req-21ac6da2-5dab-4138-bb43-0484a19d7b25'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.192908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acfb90415bfe43dab5133c213a9a0905', 'request_id': 'req-21ac6da2-5dab-4138-bb43-0484a19d7b25'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.212194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] The token cache is being invalidate because project acfb90415bfe43dab5133c213a9a0905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:03.213099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.214307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.216572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 898/1794] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:02 2022] DELETE /identity/v3/projects/acfb90415bfe43dab5133c213a9a0905 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:03.221826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:03.223824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:03.256780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:03.258302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:03.258656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:03.260315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:03.261086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:03.264042 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:03.301044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 897/1795] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:03 2022] POST /identity/v3/users => generated 310 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:03.305872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:03.311333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:03.377229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31024-39d0-45b2-98f8-5ece7f354813 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:03.389786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:03.392257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:03.392550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:03.392822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:03.397862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:03.402002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:03.406875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6da2-5dab-4138-bb43-0484a19d7b25 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:03.417040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:03.417704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:03.418012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:03.418287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] PATH_INFO: `/v3/users/e3ff935dafc144809b332c458d2278b4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:03.423639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ff935dafc144809b332c458d2278b4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:03.425706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:03.454048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 898/1796] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:03.456465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:03.487653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:03.490375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c9a9-597e-4711-bfc4-87ca50bb8fed admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:03.504745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:03.506125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:03.508312 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:03.509011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] PATH_INFO: `/v3/projects/df940cd32b74414fa1e55d354cbdccbf/users/e900b2b01ffa4d9b9a3eadc465e7f3cd/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:03.522165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ff935dafc144809b332c458d2278b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.522842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ff935dafc144809b332c458d2278b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.540088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ff935dafc144809b332c458d2278b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.554142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ff935dafc144809b332c458d2278b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.555141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ff935dafc144809b332c458d2278b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:03.570854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df940cd32b74414fa1e55d354cbdccbf, user_id=e900b2b01ffa4d9b9a3eadc465e7f3cd, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:03.573598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:03.595964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 899/1797] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:03 2022] DELETE /identity/v3/users/e3ff935dafc144809b332c458d2278b4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:03.622326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 899/1798] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:03 2022] PUT /identity/v3/projects/df940cd32b74414fa1e55d354cbdccbf/users/e900b2b01ffa4d9b9a3eadc465e7f3cd/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:03.626569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:03.628299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:03.763127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93885e8a-1fe1-48bd-bc79-61260b22383d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:03.953642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02022cd4-854e-4182-a21f-c54a100d26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:03.954920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02022cd4-854e-4182-a21f-c54a100d26e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:03.955618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02022cd4-854e-4182-a21f-c54a100d26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:03.956021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02022cd4-854e-4182-a21f-c54a100d26e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:03.956886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02022cd4-854e-4182-a21f-c54a100d26e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:03.958685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02022cd4-854e-4182-a21f-c54a100d26e6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:03.985062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 900/1799] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:03.989472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.006336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124c7b-8a42-44de-8fb4-e17a07198626 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.018304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.019000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.019283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.019566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] PATH_INFO: `/v3/projects/df940cd32b74414fa1e55d354cbdccbf/users/e900b2b01ffa4d9b9a3eadc465e7f3cd/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.023302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df940cd32b74414fa1e55d354cbdccbf, user_id=e900b2b01ffa4d9b9a3eadc465e7f3cd, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.026335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.066211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.066502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.066782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.069553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 900/1800] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:03 2022] PUT /identity/v3/projects/df940cd32b74414fa1e55d354cbdccbf/users/e900b2b01ffa4d9b9a3eadc465e7f3cd/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:04.098062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] MFA Rules not processed for user `e900b2b01ffa4d9b9a3eadc465e7f3cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:04.099295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:04.135542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:04.184533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.186282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:04.207265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 901/1801] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:04.219961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.222546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:04.317937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0a22-35bd-4ab5-9cca-e1f4f57c3670 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.319684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bffe4b-f2c1-4468-818c-f404d7b61e08 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.323391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135457b5-a607-40c5-a59f-a309b63faea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.324429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135457b5-a607-40c5-a59f-a309b63faea1 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.324903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135457b5-a607-40c5-a59f-a309b63faea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.325346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135457b5-a607-40c5-a59f-a309b63faea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.328051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.328987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.329280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.329562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] PATH_INFO: `/v3/projects/054b77c48a674d31a2d2144aee6ee878` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.331330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054b77c48a674d31a2d2144aee6ee878)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.334408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.359771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135457b5-a607-40c5-a59f-a309b63faea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.361565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135457b5-a607-40c5-a59f-a309b63faea1 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.372616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 902/1802] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:04 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:04.413484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:04.456014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054b77c48a674d31a2d2144aee6ee878', 'request_id': 'req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:04.472952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054b77c48a674d31a2d2144aee6ee878', 'request_id': 'req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:04.484051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054b77c48a674d31a2d2144aee6ee878', 'request_id': 'req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:04.508377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] The token cache is being invalidate because project 054b77c48a674d31a2d2144aee6ee878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:04.508377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:04.508377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:04.508377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 901/1803] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:04 2022] DELETE /identity/v3/projects/054b77c48a674d31a2d2144aee6ee878 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:04.509673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589f6c1-84ec-43b8-9416-dfd0fecb6b3b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.509981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589f6c1-84ec-43b8-9416-dfd0fecb6b3b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.510272 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589f6c1-84ec-43b8-9416-dfd0fecb6b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.534687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2589f6c1-84ec-43b8-9416-dfd0fecb6b3b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:04.535961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2589f6c1-84ec-43b8-9416-dfd0fecb6b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:04.588617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.590903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:04.608887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 903/1804] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:04.617297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f67eb-18dc-4436-98e2-e2bfe1e18dc1 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.617582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f67eb-18dc-4436-98e2-e2bfe1e18dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.617859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f67eb-18dc-4436-98e2-e2bfe1e18dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.643067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2e6f67eb-18dc-4436-98e2-e2bfe1e18dc1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:04.644542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2e6f67eb-18dc-4436-98e2-e2bfe1e18dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:04.653574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 904/1805] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:04.658817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f67eb-18dc-4436-98e2-e2bfe1e18dc1 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.669413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f67eb-18dc-4436-98e2-e2bfe1e18dc1 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.672518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f028253-b4c2-4f2b-94d1-a0745bdf03f9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.674489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.675345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.675635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.676070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.676560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:04.676723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.676856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.677489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.677950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.678218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.678526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.680979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:04.691171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 905/1806] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:50:04.695315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.705745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5492e3-f646-40ad-a554-82c3dd0fa362 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.711258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.711868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.712152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.712428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.713101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.715007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.751586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 906/1807] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:04 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:04.755424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.764065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.765666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.790873 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 902/1808] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:04 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:04.794259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:04.830540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f938-d9d9-4319-ac8e-780aa077cacf admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.838886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.840085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.840381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.840665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.841593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.844591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.876785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 907/1809] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:04 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:04.880869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.892617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bbfb2-a5fc-442b-b7ce-03af032bc272 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.898827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.899538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.899822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.900094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.900738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.902413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.914015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 903/1810] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:04.918073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.942539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8516-0b77-4334-850a-a8db0ac34d66 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.942539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305f41f-40d5-41ce-850f-cab143e65a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.942539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f41f-40d5-41ce-850f-cab143e65a4a admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.942539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f41f-40d5-41ce-850f-cab143e65a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.943003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f41f-40d5-41ce-850f-cab143e65a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:04.943003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305f41f-40d5-41ce-850f-cab143e65a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:04.943003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305f41f-40d5-41ce-850f-cab143e65a4a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:04.953639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 908/1811] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:04.957857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:04.969249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56980d2-bf0c-4bcd-9df4-869cb10175ec admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:04.981461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:04.982654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:04.982654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:04.982819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] PATH_INFO: `/v3/projects/0b2935b764584d639be243b86282e504/users/7811131e596d49b680190dab146a75d9/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.002362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2935b764584d639be243b86282e504, user_id=7811131e596d49b680190dab146a75d9, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.005203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.029697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 904/1812] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:04 2022] PUT /identity/v3/projects/0b2935b764584d639be243b86282e504/users/7811131e596d49b680190dab146a75d9/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:05.043632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f097-ec5e-4968-8330-c217ec0c5fc4 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.043993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f097-ec5e-4968-8330-c217ec0c5fc4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.044347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f097-ec5e-4968-8330-c217ec0c5fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.088345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9659f097-ec5e-4968-8330-c217ec0c5fc4 None None] MFA Rules not processed for user `7811131e596d49b680190dab146a75d9`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:05.089926 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9659f097-ec5e-4968-8330-c217ec0c5fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:05.200959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 909/1813] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:05.208307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:05.264039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:05.293572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81949617-477d-462f-8426-5d919cd3853c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:05.302589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:05.303258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.303526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.303796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.304455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.306476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.341427 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 905/1814] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:05 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:05.346187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f097-ec5e-4968-8330-c217ec0c5fc4 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:05.364480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f097-ec5e-4968-8330-c217ec0c5fc4 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:05.444405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:05.445382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.445793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.446928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.446928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.448961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.480308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 910/1815] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:05 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:05.482051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:05.507447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71da07-226c-4f71-9458-603b9b988447 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:05.515415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:05.522729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.523094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.523570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.524899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.526874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.540753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 906/1816] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:05.545452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:05.565897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f668826-bf75-4c02-8f83-bf8ea3c83280 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:05.573128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:05.573814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.574101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.574381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] PATH_INFO: `/v3/projects/2bd7a3abc9be40eb944b1bf9b2f7d4bf/users/f87e9d30093f48ffb41ea37ddccc88b9/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.593543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd7a3abc9be40eb944b1bf9b2f7d4bf, user_id=f87e9d30093f48ffb41ea37ddccc88b9, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.596612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.615213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 911/1817] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:05 2022] PUT /identity/v3/projects/2bd7a3abc9be40eb944b1bf9b2f7d4bf/users/f87e9d30093f48ffb41ea37ddccc88b9/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:05.620903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:05.631124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ae8d-b77e-42c5-b5e5-7f9053e7995d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:05.709410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401e6fd-de70-4562-bd5a-92fb57d20527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:05.710027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e6fd-de70-4562-bd5a-92fb57d20527 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.710311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e6fd-de70-4562-bd5a-92fb57d20527 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.710584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401e6fd-de70-4562-bd5a-92fb57d20527 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.711263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e6fd-de70-4562-bd5a-92fb57d20527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.712885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401e6fd-de70-4562-bd5a-92fb57d20527 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.723259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 907/1818] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:05.729420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:05.741667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dadf88-4bd0-47e1-8c49-ab83ddb8ad53 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:05.747555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:05.748218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.748501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.748774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] PATH_INFO: `/v3/projects/2bd7a3abc9be40eb944b1bf9b2f7d4bf/users/f87e9d30093f48ffb41ea37ddccc88b9/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.750977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd7a3abc9be40eb944b1bf9b2f7d4bf, user_id=f87e9d30093f48ffb41ea37ddccc88b9, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.753713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.756043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:05.766405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 912/1819] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:05 2022] PUT /identity/v3/projects/2bd7a3abc9be40eb944b1bf9b2f7d4bf/users/f87e9d30093f48ffb41ea37ddccc88b9/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:05.777755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47f492-b1c8-402e-beca-321867758dcb None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.778040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47f492-b1c8-402e-beca-321867758dcb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.778315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47f492-b1c8-402e-beca-321867758dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.808201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7d47f492-b1c8-402e-beca-321867758dcb None None] MFA Rules not processed for user `f87e9d30093f48ffb41ea37ddccc88b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:05.809459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7d47f492-b1c8-402e-beca-321867758dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:05.885498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 908/1820] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:05.897502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:05.899625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:05.963070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ac790-c6e6-4773-9375-32f3ebb6411b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:05.968261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:05.969170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:05.969454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:05.969775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:05.982381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:05.984789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:05.995946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 913/1821] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:06.049366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47f492-b1c8-402e-beca-321867758dcb None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:06.059777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47f492-b1c8-402e-beca-321867758dcb None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:06.064074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87944ec-223c-4920-8a0c-b87985267d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:06.064690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87944ec-223c-4920-8a0c-b87985267d25 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:06.064998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87944ec-223c-4920-8a0c-b87985267d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:06.065262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87944ec-223c-4920-8a0c-b87985267d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:06.097593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:06.145254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87944ec-223c-4920-8a0c-b87985267d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:06.146629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87944ec-223c-4920-8a0c-b87985267d25 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:06.155672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 909/1822] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:08.722164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:08.723690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:08.793498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d9658-e4a2-40ae-9860-a6818c87311d service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:08.798890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:08.799711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:08.800019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:08.800299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] PATH_INFO: `/v3/users/8e91c9887e494f94b275f4b6d293942d` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:08.801643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e91c9887e494f94b275f4b6d293942d)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:08.803565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:08.859334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e91c9887e494f94b275f4b6d293942d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:08.859997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e91c9887e494f94b275f4b6d293942d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:08.867018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e91c9887e494f94b275f4b6d293942d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:08.875599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e91c9887e494f94b275f4b6d293942d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:08.876262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e91c9887e494f94b275f4b6d293942d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:08.893561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 914/1823] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:08 2022] DELETE /identity/v3/users/8e91c9887e494f94b275f4b6d293942d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:08.898267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:08.898789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:08.898936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:08.919154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:08.920440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:08.986793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 910/1824] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:09.000004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:09.001613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:09.025715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:09.071363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ec3fe-3085-4cd1-ba19-e9677ed22a30 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:09.074880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99be49-edc9-4ed4-baa2-6a900e3c90ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:09.075496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99be49-edc9-4ed4-baa2-6a900e3c90ab service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:09.075786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99be49-edc9-4ed4-baa2-6a900e3c90ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:09.076060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99be49-edc9-4ed4-baa2-6a900e3c90ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:09.086238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99be49-edc9-4ed4-baa2-6a900e3c90ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:09.087752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99be49-edc9-4ed4-baa2-6a900e3c90ab service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:09.099473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 915/1825] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:09.869554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:09.871204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:09.887039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572dc41-355c-4a82-9950-432ed4a37cc2 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:09.892660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:09.893468 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:09.893870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:09.894272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] PATH_INFO: `/v3/users/7811131e596d49b680190dab146a75d9` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:09.895529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7811131e596d49b680190dab146a75d9)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:09.897627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:09.969734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7811131e596d49b680190dab146a75d9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:09.971665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7811131e596d49b680190dab146a75d9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:09.985048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7811131e596d49b680190dab146a75d9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:09.986922 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7811131e596d49b680190dab146a75d9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:10.010181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7811131e596d49b680190dab146a75d9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:10.037211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 911/1826] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:09 2022] DELETE /identity/v3/users/7811131e596d49b680190dab146a75d9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:10.038897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:10.039384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:10.039461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:10.078955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:10.080297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:10.195136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 916/1827] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:10.216765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:10.219124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:10.317510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:10.334965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb9c7-b452-4d40-9637-90580f23fdb3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:10.348783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:10.349486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:10.349763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:10.350034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:10.368180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:10.390351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:10.430862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 912/1828] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:10.698517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:10.698517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:10.713212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f106d1a-0017-4cd3-aa64-67027fab6a35 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:10.741916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:10.742882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:10.743320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:10.743727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] PATH_INFO: `/v3/users/5a8d507fbdd34ee1ae2de64a4d46dc44` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:10.748952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8d507fbdd34ee1ae2de64a4d46dc44)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:10.752489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:10.776202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:10.777879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:10.823541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fedabd-23fb-4014-851f-eb61da125ff4 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:10.861584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:10.862794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:10.863077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:10.863351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] PATH_INFO: `/v3/projects/224826ad62114cb4a7f1a328ada88f4e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:10.865299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224826ad62114cb4a7f1a328ada88f4e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:10.868470 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:10.898378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8d507fbdd34ee1ae2de64a4d46dc44'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:10.901283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8d507fbdd34ee1ae2de64a4d46dc44'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:10.924193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8d507fbdd34ee1ae2de64a4d46dc44'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:10.942514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8d507fbdd34ee1ae2de64a4d46dc44'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:10.943699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f37834ae-63ce-4741-aa47-c42bedb882a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8d507fbdd34ee1ae2de64a4d46dc44'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:10.983645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 917/1829] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:10 2022] DELETE /identity/v3/users/5a8d507fbdd34ee1ae2de64a4d46dc44 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:10.983645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ed02-86a5-4629-8399-e51137347768 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:10.983953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ed02-86a5-4629-8399-e51137347768 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:10.984544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84ed02-86a5-4629-8399-e51137347768 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:10.989472 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 918/1830] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:50:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:50:10.994076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:10.994387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:10.994677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:10.995158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224826ad62114cb4a7f1a328ada88f4e', 'request_id': 'req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.014007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224826ad62114cb4a7f1a328ada88f4e', 'request_id': 'req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.032875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224826ad62114cb4a7f1a328ada88f4e', 'request_id': 'req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.065690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:11.070030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.078893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] The token cache is being invalidate because project 224826ad62114cb4a7f1a328ada88f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:11.079236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.080062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7d9a8bba-4e65-4bcc-b1de-d5397e15f2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.089178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 913/1831] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:10 2022] DELETE /identity/v3/projects/224826ad62114cb4a7f1a328ada88f4e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:11.089178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.089178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.089178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.116887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:11.118150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.125388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:11.166317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 919/1832] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:11.167214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.173141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.194073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f298ea6-709c-4d87-969d-3abbfb336da3 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:11.201519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:11.202385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.202947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.204279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] PATH_INFO: `/v3/users/1b791d7adf9d420bb9d9a2ec3cd4cef8` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.206167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b791d7adf9d420bb9d9a2ec3cd4cef8)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:11.209042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:11.222337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 914/1833] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:50:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:11.223377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.224686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.251924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938abf60-d66a-4ddf-86e8-2767d3f34efa None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:11.258833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:11.259702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.260024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.260367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] PATH_INFO: `/v3/users/3f699023c4244a41b4f0222bdaa28ed9` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.261624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f699023c4244a41b4f0222bdaa28ed9)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:11.264215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:11.298424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b791d7adf9d420bb9d9a2ec3cd4cef8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.300826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b791d7adf9d420bb9d9a2ec3cd4cef8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.314249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b791d7adf9d420bb9d9a2ec3cd4cef8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.334394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b791d7adf9d420bb9d9a2ec3cd4cef8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.335839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b791d7adf9d420bb9d9a2ec3cd4cef8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.338794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f699023c4244a41b4f0222bdaa28ed9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.340212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f699023c4244a41b4f0222bdaa28ed9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.351493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f699023c4244a41b4f0222bdaa28ed9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.352449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f699023c4244a41b4f0222bdaa28ed9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.355039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:11.367978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 920/1834] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:11 2022] DELETE /identity/v3/users/1b791d7adf9d420bb9d9a2ec3cd4cef8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:11.369121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.370857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.376618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f699023c4244a41b4f0222bdaa28ed9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.393266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 915/1835] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:11 2022] DELETE /identity/v3/users/3f699023c4244a41b4f0222bdaa28ed9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:11.396227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.396737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.489584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149b28-0d53-45f7-ac0c-5ad59aea4e94 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:11.558986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f56c8f-3acb-4304-b4a2-4576d1e15bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:11.559613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f56c8f-3acb-4304-b4a2-4576d1e15bcc service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.560029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f56c8f-3acb-4304-b4a2-4576d1e15bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.560326 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f56c8f-3acb-4304-b4a2-4576d1e15bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.562304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-61f56c8f-3acb-4304-b4a2-4576d1e15bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.574866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25309da8-263b-4286-8015-4c2643223ec1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:11.578578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:11.592061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:11.592987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.593264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.593649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.607918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.637966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:11.639681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:11.651651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 916/1836] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:11.660706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f56c8f-3acb-4304-b4a2-4576d1e15bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:11.662317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f56c8f-3acb-4304-b4a2-4576d1e15bcc service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:11.664712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.668527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.690601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 921/1837] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:11.692198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.692520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.696256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.697222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01673e-5c32-4663-8ca0-099d8e5a01c1 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:11.711345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:11.712165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.712605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.713041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] PATH_INFO: `/v3/projects/0b2935b764584d639be243b86282e504` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.715054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2935b764584d639be243b86282e504)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:11.721016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:11.740178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:11.741415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.761315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 922/1838] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:11.778074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.779501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.801992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91685d10-6e62-425e-a1b6-59509c423f22 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:11.807999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:11.809083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:11.809581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:11.809581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:11.841741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:11.843735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:11.844452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2935b764584d639be243b86282e504', 'request_id': 'req-95378465-76db-430f-8172-d3f00d1fcb1f'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.859824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2935b764584d639be243b86282e504', 'request_id': 'req-95378465-76db-430f-8172-d3f00d1fcb1f'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.865992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 923/1839] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:11.870287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.873068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2935b764584d639be243b86282e504', 'request_id': 'req-95378465-76db-430f-8172-d3f00d1fcb1f'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.875102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:11.917800 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7c90d-003f-4849-9647-69f24f98b5bf service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:11.926782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] The token cache is being invalidate because project 0b2935b764584d639be243b86282e504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:11.927084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.928067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:11.930085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 917/1840] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:11 2022] DELETE /identity/v3/projects/0b2935b764584d639be243b86282e504 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:11.935145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:11.945595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.007555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:12.010862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:12.012820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.014374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.014910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] PATH_INFO: `/v3/projects/152da6c29e9e42d9914ce09f4be7cb2b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.017575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=152da6c29e9e42d9914ce09f4be7cb2b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:12.022005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:12.044074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95378465-76db-430f-8172-d3f00d1fcb1f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:12.061480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:12.061480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.061480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.061480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] PATH_INFO: `/v3/users/f87e9d30093f48ffb41ea37ddccc88b9` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.061882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87e9d30093f48ffb41ea37ddccc88b9)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:12.061882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:12.132634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152da6c29e9e42d9914ce09f4be7cb2b', 'request_id': 'req-4654ca69-beb3-4d41-91b7-3c6ae952c485'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.152957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87e9d30093f48ffb41ea37ddccc88b9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.152957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87e9d30093f48ffb41ea37ddccc88b9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.153395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152da6c29e9e42d9914ce09f4be7cb2b', 'request_id': 'req-4654ca69-beb3-4d41-91b7-3c6ae952c485'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.156316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152da6c29e9e42d9914ce09f4be7cb2b', 'request_id': 'req-4654ca69-beb3-4d41-91b7-3c6ae952c485'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.159223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87e9d30093f48ffb41ea37ddccc88b9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.160761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87e9d30093f48ffb41ea37ddccc88b9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.174196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] The token cache is being invalidate because project 152da6c29e9e42d9914ce09f4be7cb2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:12.174751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.175804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4654ca69-beb3-4d41-91b7-3c6ae952c485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.177826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87e9d30093f48ffb41ea37ddccc88b9'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.178401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 924/1841] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:11 2022] DELETE /identity/v3/projects/152da6c29e9e42d9914ce09f4be7cb2b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:12.182833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bb15d-7742-4271-aaa3-8ad53e51b0dc None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.183120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bb15d-7742-4271-aaa3-8ad53e51b0dc None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.183390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bb15d-7742-4271-aaa3-8ad53e51b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.197521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 918/1842] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:11 2022] DELETE /identity/v3/users/f87e9d30093f48ffb41ea37ddccc88b9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:12.203831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-507bb15d-7742-4271-aaa3-8ad53e51b0dc None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:12.205099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-507bb15d-7742-4271-aaa3-8ad53e51b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.224680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:12.316613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:12.318405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.344169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 925/1843] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:12.344479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1779a1-ec56-4a54-a3fb-45e0818760df admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:12.346242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263b1a-29d1-4ae0-8022-f2490c5a846f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.346658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263b1a-29d1-4ae0-8022-f2490c5a846f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.347030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263b1a-29d1-4ae0-8022-f2490c5a846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.354218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:12.355163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.358598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.359209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] PATH_INFO: `/v3/projects/483175f7b02e465896a67edd9f5905ce` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.361827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483175f7b02e465896a67edd9f5905ce)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:12.364495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:12.394894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1b263b1a-29d1-4ae0-8022-f2490c5a846f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:12.406382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1b263b1a-29d1-4ae0-8022-f2490c5a846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.428707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 926/1844] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:12.432849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263b1a-29d1-4ae0-8022-f2490c5a846f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:12.458797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263b1a-29d1-4ae0-8022-f2490c5a846f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:12.488792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483175f7b02e465896a67edd9f5905ce', 'request_id': 'req-fc113093-a6e5-4356-a48c-9a4f80aca242'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.515101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483175f7b02e465896a67edd9f5905ce', 'request_id': 'req-fc113093-a6e5-4356-a48c-9a4f80aca242'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.525318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483175f7b02e465896a67edd9f5905ce', 'request_id': 'req-fc113093-a6e5-4356-a48c-9a4f80aca242'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.547587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] The token cache is being invalidate because project 483175f7b02e465896a67edd9f5905ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:12.547982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.548769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.553170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 919/1845] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:12 2022] DELETE /identity/v3/projects/483175f7b02e465896a67edd9f5905ce => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:12.556211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:12.561837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.570370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:12.571532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.571532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.571835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.572709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:12.573140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:12.575037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:12.595877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 927/1846] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:12.597522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:12.599364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.629814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400100f9-786d-4af3-abf2-265ff5e019da admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:12.635238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:12.636025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.636963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.637094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.637736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:12.640548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:12.646581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:12.683476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113093-a6e5-4356-a48c-9a4f80aca242 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:12.689180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:12.689844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.690122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.690400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] PATH_INFO: `/v3/users/e900b2b01ffa4d9b9a3eadc465e7f3cd` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.691690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e900b2b01ffa4d9b9a3eadc465e7f3cd)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:12.693821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:12.704147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 928/1847] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:12 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:12.704147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:12.704147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.761164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e900b2b01ffa4d9b9a3eadc465e7f3cd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.761867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e900b2b01ffa4d9b9a3eadc465e7f3cd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.771290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e900b2b01ffa4d9b9a3eadc465e7f3cd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.771921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e900b2b01ffa4d9b9a3eadc465e7f3cd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.781628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bd6ea-9ed8-4457-b0ee-15a7c3f8f464 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:12.785133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e900b2b01ffa4d9b9a3eadc465e7f3cd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.786386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:12.787026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:12.787311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:12.787584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] PATH_INFO: `/v3/projects/2bd7a3abc9be40eb944b1bf9b2f7d4bf` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:12.788703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd7a3abc9be40eb944b1bf9b2f7d4bf)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:12.790706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:12.819774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 920/1848] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:12 2022] DELETE /identity/v3/users/e900b2b01ffa4d9b9a3eadc465e7f3cd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:12.819774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:12.819774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:12.844238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:12.865547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd7a3abc9be40eb944b1bf9b2f7d4bf', 'request_id': 'req-53845200-b2f3-4a3f-b082-d2aaa64397fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.888765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd7a3abc9be40eb944b1bf9b2f7d4bf', 'request_id': 'req-53845200-b2f3-4a3f-b082-d2aaa64397fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.906132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd7a3abc9be40eb944b1bf9b2f7d4bf', 'request_id': 'req-53845200-b2f3-4a3f-b082-d2aaa64397fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.907777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbd215-44e3-4e69-98fd-a35248a692ef admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:12.924642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] The token cache is being invalidate because project 2bd7a3abc9be40eb944b1bf9b2f7d4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:12.924961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.925652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:12.928502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 929/1849] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:12 2022] DELETE /identity/v3/projects/2bd7a3abc9be40eb944b1bf9b2f7d4bf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:12.929238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:12.930615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.014388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.016769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.017378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.017794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] PATH_INFO: `/v3/projects/e2b923a6404d4deeb8f69c8b05a2d82b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.019652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b923a6404d4deeb8f69c8b05a2d82b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.022257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.037613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:13.052390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53845200-b2f3-4a3f-b082-d2aaa64397fc admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.074807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39f489-94f7-41e8-8cd6-3140d7db1c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.074807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f489-94f7-41e8-8cd6-3140d7db1c4d admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.075250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f489-94f7-41e8-8cd6-3140d7db1c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.081303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39f489-94f7-41e8-8cd6-3140d7db1c4d admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.082024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39f489-94f7-41e8-8cd6-3140d7db1c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.083996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39f489-94f7-41e8-8cd6-3140d7db1c4d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.105996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b923a6404d4deeb8f69c8b05a2d82b', 'request_id': 'req-78ff61c1-73d3-4ac7-8d7f-922c73359108'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.119236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b923a6404d4deeb8f69c8b05a2d82b', 'request_id': 'req-78ff61c1-73d3-4ac7-8d7f-922c73359108'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.123483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 930/1850] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:12 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:13.125385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.128376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b923a6404d4deeb8f69c8b05a2d82b', 'request_id': 'req-78ff61c1-73d3-4ac7-8d7f-922c73359108'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.128891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.129331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.142747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] The token cache is being invalidate because project e2b923a6404d4deeb8f69c8b05a2d82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:13.143040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.143854 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.145948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 921/1851] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:12 2022] DELETE /identity/v3/projects/e2b923a6404d4deeb8f69c8b05a2d82b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:13.146938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.151022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.167191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:13.169015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.253187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff61c1-73d3-4ac7-8d7f-922c73359108 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.259139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2f231-15a5-4d0a-931e-366592f1564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.261033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f231-15a5-4d0a-931e-366592f1564a admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.261327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f231-15a5-4d0a-931e-366592f1564a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.261903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2f231-15a5-4d0a-931e-366592f1564a admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.262572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2f231-15a5-4d0a-931e-366592f1564a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.265131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 931/1852] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:13.265282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2f231-15a5-4d0a-931e-366592f1564a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.266367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.267992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.282833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325074-9f3a-4941-af9d-324dedafe89a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.283335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 922/1853] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:13.284982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9cb3-7de1-4010-a60c-24641004637b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.285272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9cb3-7de1-4010-a60c-24641004637b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.285545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9cb3-7de1-4010-a60c-24641004637b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.289436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.290316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.290944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.291431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] PATH_INFO: `/v3/users/b8d525557589476e973b3c54c032c9b7` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.292771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d525557589476e973b3c54c032c9b7)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.296454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.307610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-fb2b9cb3-7de1-4010-a60c-24641004637b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:13.308248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fb2b9cb3-7de1-4010-a60c-24641004637b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.317290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 923/1854] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:13.318330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b9cb3-7de1-4010-a60c-24641004637b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.328478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b9cb3-7de1-4010-a60c-24641004637b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.334328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.334655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.334848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.335093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.335956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.337769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.357261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 924/1855] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:13.359475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.365880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:13.373216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d525557589476e973b3c54c032c9b7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.375715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d525557589476e973b3c54c032c9b7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.384847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d57cb1-64f7-4bbe-aaf1-c228e9e173d6 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.390096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d525557589476e973b3c54c032c9b7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.392788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.394897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.395482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.396831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.398217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:13.398845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.401660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.404229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d525557589476e973b3c54c032c9b7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.405411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d525557589476e973b3c54c032c9b7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:13.431765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 925/1856] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:13.433300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.436092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.457318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2defd1-9348-467a-9a1f-f4ef8cb1ed7c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.461331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 932/1857] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:13 2022] DELETE /identity/v3/users/b8d525557589476e973b3c54c032c9b7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:13.462316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.466879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.597384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab112b-24da-4111-9ed7-add4dfc99504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.598513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab112b-24da-4111-9ed7-add4dfc99504 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.599001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab112b-24da-4111-9ed7-add4dfc99504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.599429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab112b-24da-4111-9ed7-add4dfc99504 admin admin] PATH_INFO: `/v3/projects/c747fb00bda94f56aad1c382db1fa826/users/72e8079cb3bd4a0aaca4677a1dd7f66a/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.611764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311237b-f49a-47ec-8ad7-2a51ef4da959 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.612431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:13.620053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.620662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.621750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.621863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.622555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.625918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.634781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab112b-24da-4111-9ed7-add4dfc99504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c747fb00bda94f56aad1c382db1fa826, user_id=72e8079cb3bd4a0aaca4677a1dd7f66a, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.641533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab112b-24da-4111-9ed7-add4dfc99504 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.665787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 933/1858] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:13 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:13.669959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.672494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 926/1859] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:13 2022] PUT /identity/v3/projects/c747fb00bda94f56aad1c382db1fa826/users/72e8079cb3bd4a0aaca4677a1dd7f66a/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:13.692835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d889-1ebd-4816-9d13-a04799f1d6b3 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.693420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d889-1ebd-4816-9d13-a04799f1d6b3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.693544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d889-1ebd-4816-9d13-a04799f1d6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.744889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8954d889-1ebd-4816-9d13-a04799f1d6b3 None None] MFA Rules not processed for user `72e8079cb3bd4a0aaca4677a1dd7f66a`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:13.746202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8954d889-1ebd-4816-9d13-a04799f1d6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:13.840125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f909d-62b7-4968-9c3e-8c27f5741a51 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.847082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.847518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.847909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.848255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.849661 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.851437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.882033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 934/1860] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:13 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:13.884484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.897426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c153c-54b8-4493-9c77-0b554f4ec66b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.905122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 927/1861] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:13.905296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.905296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.905296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.905296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.905636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.906872 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.907013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d889-1ebd-4816-9d13-a04799f1d6b3 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.926461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 935/1862] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:13.927930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.933484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d889-1ebd-4816-9d13-a04799f1d6b3 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.940328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021af5-0c93-4d3b-adcd-136bed1dbcdd admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:13.945922 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.947014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.947927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.948345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.948874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:13.949444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.951066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:13.951478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:13.952089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.952579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:13.953911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:13.957776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:13.989512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 936/1863] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:13.995758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:13.995946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 928/1864] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:13 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:14.002399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.009134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3083107-9828-49f6-93da-dad57cbeec36 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.020169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:14.094711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095f617-b288-4bc7-9993-75d4577462db admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.103576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.104449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.104778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.105162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.105951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.109540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.127891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142c01c-9ec0-434f-9e68-22bf954d75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.129088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c01c-9ec0-434f-9e68-22bf954d75b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.129603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c01c-9ec0-434f-9e68-22bf954d75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.130085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c01c-9ec0-434f-9e68-22bf954d75b3 admin admin] PATH_INFO: `/v3/projects/feb64b2ba2e74b81b915af0ebea22901/users/9db3ecb16e1f4c7ba648d6f6abee1d00/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.138572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 929/1865] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:14 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:14.143130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.156047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b955fb3-dff0-485d-ae71-4ac8b6ff91d9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.156483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142c01c-9ec0-434f-9e68-22bf954d75b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb64b2ba2e74b81b915af0ebea22901, user_id=9db3ecb16e1f4c7ba648d6f6abee1d00, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.159909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142c01c-9ec0-434f-9e68-22bf954d75b3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.160690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.161454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.161834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.162336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.162949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.164896 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.178807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 930/1866] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:14.180976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 937/1867] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:13 2022] PUT /identity/v3/projects/feb64b2ba2e74b81b915af0ebea22901/users/9db3ecb16e1f4c7ba648d6f6abee1d00/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:14.183456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.194722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a56f-24eb-4654-960b-7ac4b0953ec1 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.195009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a56f-24eb-4654-960b-7ac4b0953ec1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.195288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a56f-24eb-4654-960b-7ac4b0953ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.196452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36081b20-0b3b-4a88-ae73-bd9187b45489 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.240278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-44d4a56f-24eb-4654-960b-7ac4b0953ec1 None None] MFA Rules not processed for user `9db3ecb16e1f4c7ba648d6f6abee1d00`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:14.241616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-44d4a56f-24eb-4654-960b-7ac4b0953ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:14.251670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:14.327948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.330467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.330768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.331950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] PATH_INFO: `/v3/projects/efa7883358fe4262bcd51a619283d833/users/896e24aefb724d53bebea9fa0ccb2b93/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.367630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa7883358fe4262bcd51a619283d833, user_id=896e24aefb724d53bebea9fa0ccb2b93, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.373361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.400765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 931/1868] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:14 2022] PUT /identity/v3/projects/efa7883358fe4262bcd51a619283d833/users/896e24aefb724d53bebea9fa0ccb2b93/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:14.406068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.437480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 938/1869] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:14.442352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4a56f-24eb-4654-960b-7ac4b0953ec1 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.464591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4a56f-24eb-4654-960b-7ac4b0953ec1 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.526047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1a5df-a2a0-4b11-acf0-689e010aaf02 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.532327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.532974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.533259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.533530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.534178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.535948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.550410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 932/1870] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:14.554277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.576060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457dfd-81da-4487-b399-f7ddd152d405 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.595161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aae6a-018d-4cb9-8287-5d9a1e9f1d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.595475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aae6a-018d-4cb9-8287-5d9a1e9f1d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.595759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aae6a-018d-4cb9-8287-5d9a1e9f1d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.596036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aae6a-018d-4cb9-8287-5d9a1e9f1d69 admin admin] PATH_INFO: `/v3/projects/efa7883358fe4262bcd51a619283d833/users/896e24aefb724d53bebea9fa0ccb2b93/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.598744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aae6a-018d-4cb9-8287-5d9a1e9f1d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa7883358fe4262bcd51a619283d833, user_id=896e24aefb724d53bebea9fa0ccb2b93, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.603511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aae6a-018d-4cb9-8287-5d9a1e9f1d69 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.618574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.619760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.621239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.621776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.622567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.625558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 933/1871] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:14 2022] PUT /identity/v3/projects/efa7883358fe4262bcd51a619283d833/users/896e24aefb724d53bebea9fa0ccb2b93/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:14.626246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.636645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71a9ae-39af-4f00-adac-249d34c9f043 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.636938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71a9ae-39af-4f00-adac-249d34c9f043 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.637246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71a9ae-39af-4f00-adac-249d34c9f043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.669122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 939/1872] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:14 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:14.669847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-bd71a9ae-39af-4f00-adac-249d34c9f043 None None] MFA Rules not processed for user `896e24aefb724d53bebea9fa0ccb2b93`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:14.670035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.672281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bd71a9ae-39af-4f00-adac-249d34c9f043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:14.681862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:14.782776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000be1b9-fab0-4c34-9fc2-a64933306907 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.791664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.792730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.793226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.793707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.794565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.797594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.846207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 934/1873] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:14.849791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 940/1874] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:14 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:14.860861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.861680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71a9ae-39af-4f00-adac-249d34c9f043 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.862727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:14.874229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71a9ae-39af-4f00-adac-249d34c9f043 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.881693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.882442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.882821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.883841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.884679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.886623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.902250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 935/1875] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:14.903336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:14.915088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840e9c-5dc0-4047-b944-8f41a706ab93 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.923415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.924208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.924535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.924813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] PATH_INFO: `/v3/projects/209463633267411b95a7b0995c6eedb7/users/61bcad3dfc44475e8c32509c800230bc/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:14.960776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:14.971507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] RBAC: Authorizing `identity:create_grant(project_id=209463633267411b95a7b0995c6eedb7, user_id=61bcad3dfc44475e8c32509c800230bc, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:14.974060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4623b-cfab-4e21-aeeb-3fac3f405a89 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:14.975681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:14.988690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:14.991349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:14.991778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:14.992406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.005138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 936/1876] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:14 2022] PUT /identity/v3/projects/209463633267411b95a7b0995c6eedb7/users/61bcad3dfc44475e8c32509c800230bc/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:15.005138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.012892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.018429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.020722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.056530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 941/1877] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:15.057579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.084223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47361074-2f90-4f0d-a085-c107c1d7b547 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.157986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb41c-1a7e-4412-a642-2e3bf20452df admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.177742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.178535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.178944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.179325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] PATH_INFO: `/v3/projects/a1f67a25d3a643ca9ef78d3ac6721cca` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.180841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f67a25d3a643ca9ef78d3ac6721cca)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.183201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.204396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.205225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.205831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.205937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.215099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.217510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.233756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 942/1878] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:15.233756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.233756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.242821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f67a25d3a643ca9ef78d3ac6721cca', 'request_id': 'req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.245762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ee38-d1b9-46f1-b4cc-fbdf2f5c3b55 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.252021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f67a25d3a643ca9ef78d3ac6721cca', 'request_id': 'req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.259909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f67a25d3a643ca9ef78d3ac6721cca', 'request_id': 'req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.272260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] The token cache is being invalidate because project a1f67a25d3a643ca9ef78d3ac6721cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:15.272629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.273518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.275454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 937/1879] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:15 2022] DELETE /identity/v3/projects/a1f67a25d3a643ca9ef78d3ac6721cca => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:15.276584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.278058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.287338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:15.316344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.317253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.317703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.318043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] PATH_INFO: `/v3/projects/df940cd32b74414fa1e55d354cbdccbf` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.319364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df940cd32b74414fa1e55d354cbdccbf)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.321519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.340136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96f28-abd7-43a0-bd0a-8f0e9331be8d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.343888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91aace-8dd8-4181-8a45-7f269abf538c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.344518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91aace-8dd8-4181-8a45-7f269abf538c service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.344797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91aace-8dd8-4181-8a45-7f269abf538c service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.345097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91aace-8dd8-4181-8a45-7f269abf538c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.346839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ed91aace-8dd8-4181-8a45-7f269abf538c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.371938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df940cd32b74414fa1e55d354cbdccbf', 'request_id': 'req-90b5863c-9d39-43e6-9c7c-caad810d5283'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.378208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df940cd32b74414fa1e55d354cbdccbf', 'request_id': 'req-90b5863c-9d39-43e6-9c7c-caad810d5283'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.380946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:15.385114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df940cd32b74414fa1e55d354cbdccbf', 'request_id': 'req-90b5863c-9d39-43e6-9c7c-caad810d5283'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.399604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] The token cache is being invalidate because project df940cd32b74414fa1e55d354cbdccbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:15.399893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.400534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:15.402513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 943/1880] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:15 2022] DELETE /identity/v3/projects/df940cd32b74414fa1e55d354cbdccbf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:15.403011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.404287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.408521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91aace-8dd8-4181-8a45-7f269abf538c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.410031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91aace-8dd8-4181-8a45-7f269abf538c service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.419553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 938/1881] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:15.420971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b99a7a-3966-456f-8cff-39cec63e5ce7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.421299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b99a7a-3966-456f-8cff-39cec63e5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.421551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b99a7a-3966-456f-8cff-39cec63e5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.448026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-28b99a7a-3966-456f-8cff-39cec63e5ce7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:15.450025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-28b99a7a-3966-456f-8cff-39cec63e5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.479133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5863c-9d39-43e6-9c7c-caad810d5283 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.484892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaac19-a12d-4c66-aa81-06433924db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.485716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaac19-a12d-4c66-aa81-06433924db4d admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.485867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaac19-a12d-4c66-aa81-06433924db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.486416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaac19-a12d-4c66-aa81-06433924db4d admin admin] PATH_INFO: `/v3/projects/209463633267411b95a7b0995c6eedb7/users/61bcad3dfc44475e8c32509c800230bc/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.488705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaac19-a12d-4c66-aa81-06433924db4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=209463633267411b95a7b0995c6eedb7, user_id=61bcad3dfc44475e8c32509c800230bc, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.491432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaac19-a12d-4c66-aa81-06433924db4d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.507638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 944/1882] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:15 2022] PUT /identity/v3/projects/209463633267411b95a7b0995c6eedb7/users/61bcad3dfc44475e8c32509c800230bc/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:15.508980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b778-a157-400f-96de-7363a2aa41d2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.509271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b778-a157-400f-96de-7363a2aa41d2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.509540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b778-a157-400f-96de-7363a2aa41d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.530816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 939/1883] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:15.537304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7b35b778-a157-400f-96de-7363a2aa41d2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:15.537389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e5b9-e864-4061-9bc0-80f382e648dc None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.537389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e5b9-e864-4061-9bc0-80f382e648dc None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.537389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5e5b9-e864-4061-9bc0-80f382e648dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.537598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7b35b778-a157-400f-96de-7363a2aa41d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.567438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-6da5e5b9-e864-4061-9bc0-80f382e648dc None None] MFA Rules not processed for user `61bcad3dfc44475e8c32509c800230bc`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:15.568940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6da5e5b9-e864-4061-9bc0-80f382e648dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.602793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 945/1884] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:15.604485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabebebf-b94e-43a5-b7ba-1b00cabdfa89 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.604771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabebebf-b94e-43a5-b7ba-1b00cabdfa89 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.605115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabebebf-b94e-43a5-b7ba-1b00cabdfa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.614670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:15.646343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-aabebebf-b94e-43a5-b7ba-1b00cabdfa89 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:15.647787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-aabebebf-b94e-43a5-b7ba-1b00cabdfa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.658104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 946/1885] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:15.665293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.665293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.665293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.666319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 940/1886] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:15.667191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5e5b9-e864-4061-9bc0-80f382e648dc None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.684043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5e5b9-e864-4061-9bc0-80f382e648dc None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.690918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.691546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.691831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.692107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.692761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:15.693103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.694751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.695207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:15.696538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.705584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 947/1887] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:15.706542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.708147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:15.708731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 941/1888] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:15.712812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.727484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b4654-954c-4915-b369-852f83a69533 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.733019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.733766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.734034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.734310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.734968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:15.735599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.736901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.751598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 942/1889] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:50:15.753879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.773139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f27fc-2564-42a1-83af-110f144fe770 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.773139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.773139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.773139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.773484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.773484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.773484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.779084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dc1ea-f74f-40bf-a4ba-2a80297f0319 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.783506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.784279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.784971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.785083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.795877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.797670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.807148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 943/1890] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:15.808123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.808419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 948/1891] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:15.811565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.828113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:15.831243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79127190-09b8-477c-9d09-6110cf828edd service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.897355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9555582-ad53-49b5-a970-0fca0b982ad8 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:15.902448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.903510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.903802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.904493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.905173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.911915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.929023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:15.929659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:15.929944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:15.930547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:15.931380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:15.933572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:15.950863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 944/1892] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:15.951929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.965918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 949/1893] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:15.965918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:15.975179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca53c0-0190-4eb1-8348-d23b624133e8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.026162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1a39-3b4d-4e62-9903-d2cdf12516be admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.030149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.030775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.031068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.031322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.033186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:16.035654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.036273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.036571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.036903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.037603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.039753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.062135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 950/1894] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:15 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:16.063098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.073141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3affd5-b944-4dc1-9e59-7875e1108628 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.078049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.078660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.078993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.079272 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.079917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.081645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.087104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:16.093970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.095503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.098080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 951/1895] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:16.099124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.107537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 945/1896] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:16.108386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.110515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1608d-55a4-4ac8-8bcc-1f9dce259e7a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.116244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.116996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.117243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.117607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.118254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.119578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894e946-466c-4735-acb4-d9337849637b service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.119786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.129663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.130437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.130849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 952/1897] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:16.130976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.131232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.132053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.134151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.135389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.147149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d059c-2ec9-44a6-a5ab-fc68e965595f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.150197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 946/1898] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:16.154637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.155533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.156598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.157098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.157511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.158385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.160146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.167404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25767f-89e3-4f9e-8975-c16a2c430df5 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.173013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89445ad9-629c-4ee4-b122-a7265c484058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.174251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89445ad9-629c-4ee4-b122-a7265c484058 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.174641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89445ad9-629c-4ee4-b122-a7265c484058 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.175021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89445ad9-629c-4ee4-b122-a7265c484058 admin admin] PATH_INFO: `/v3/projects/c47e68df65d94da3b214aaddfdf9336a/users/6f3d8f46f117478887f9d0c082053266/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.180412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 953/1899] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:16.185537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.200875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89445ad9-629c-4ee4-b122-a7265c484058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47e68df65d94da3b214aaddfdf9336a, user_id=6f3d8f46f117478887f9d0c082053266, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.205136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89445ad9-629c-4ee4-b122-a7265c484058 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.205755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2251c8e-3e52-4c82-85df-0d318bc32eaa admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.213448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5ac40-983c-447b-87d6-198da1ee885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.214525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5ac40-983c-447b-87d6-198da1ee885f admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.214968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5ac40-983c-447b-87d6-198da1ee885f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.215387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5ac40-983c-447b-87d6-198da1ee885f admin admin] PATH_INFO: `/v3/projects/b6b190a746f947ff953e76599e2025dd/users/e2ac40095c3a4d53b093b97c5e446656/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.229243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 947/1900] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:16 2022] PUT /identity/v3/projects/c47e68df65d94da3b214aaddfdf9336a/users/6f3d8f46f117478887f9d0c082053266/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:16.237670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e772e3-c175-4691-8ed5-a6657ab6980f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.238168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e772e3-c175-4691-8ed5-a6657ab6980f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.238750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e772e3-c175-4691-8ed5-a6657ab6980f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.240875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5ac40-983c-447b-87d6-198da1ee885f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b190a746f947ff953e76599e2025dd, user_id=e2ac40095c3a4d53b093b97c5e446656, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.244196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5ac40-983c-447b-87d6-198da1ee885f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.263545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 954/1901] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:16 2022] PUT /identity/v3/projects/b6b190a746f947ff953e76599e2025dd/users/e2ac40095c3a4d53b093b97c5e446656/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:16.274045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4946dc9-bd18-43aa-bcad-6239fa847458 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.274475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4946dc9-bd18-43aa-bcad-6239fa847458 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.275532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4946dc9-bd18-43aa-bcad-6239fa847458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.281431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-94e772e3-c175-4691-8ed5-a6657ab6980f None None] MFA Rules not processed for user `6f3d8f46f117478887f9d0c082053266`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:16.284099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-94e772e3-c175-4691-8ed5-a6657ab6980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:16.289994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:16.355601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c4946dc9-bd18-43aa-bcad-6239fa847458 None None] MFA Rules not processed for user `e2ac40095c3a4d53b093b97c5e446656`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:16.357151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c4946dc9-bd18-43aa-bcad-6239fa847458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:16.406839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 948/1902] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:16.411415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e772e3-c175-4691-8ed5-a6657ab6980f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.445047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 955/1903] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:16.449359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4946dc9-bd18-43aa-bcad-6239fa847458 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.497463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e772e3-c175-4691-8ed5-a6657ab6980f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.504073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.504351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.505228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.505686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.507861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.510256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.563248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 949/1904] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:16 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:16.564658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4946dc9-bd18-43aa-bcad-6239fa847458 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.567611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.664751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004be3a-3b6c-4e9b-81ca-5a625438229e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.667374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:16.673837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.675937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.676396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.676809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.678223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.682181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.688658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.689360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.689610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.690051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.690671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.692625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.724657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 950/1905] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:16 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:16.728876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.731502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 956/1906] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:16 2022] POST /identity/v3/projects => generated 379 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:16.742026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.760669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a0c9f-8c6d-404f-999c-d685e6e228c6 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.797112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:16.842104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d10a0c-0a61-4d4c-8a96-d65fe3bb78c8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.851932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.852654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.853045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.854002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.855303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.858614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.869014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.869684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.869973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.870248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.870909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.872539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.885429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 951/1907] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:16.890749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.892256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 957/1908] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:16 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:16.896324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.902353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a9b4-92ea-4f3e-977e-6d5c912b4d46 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.907918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd19436-de89-420d-9461-62bec0319b20 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.908591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.909480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.909887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.910172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] PATH_INFO: `/v3/projects/5b154ac828a44c40b751ddad9bef5592/users/82c2f58203734514bec2731287cb2253/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.913043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:16.913826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:16.914920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:16.915218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:16.916105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.917734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.932886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b154ac828a44c40b751ddad9bef5592, user_id=82c2f58203734514bec2731287cb2253, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:16.936520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:16.937108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 958/1909] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:16.937459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:16.949740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4648-264d-47c8-b3c7-5567cc0b45a4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:16.958504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 952/1910] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:16 2022] PUT /identity/v3/projects/5b154ac828a44c40b751ddad9bef5592/users/82c2f58203734514bec2731287cb2253/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:16.963952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:17.024437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:17.025160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.025598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.025878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] PATH_INFO: `/v3/projects/c9669b7a93634363877de6eca3d523ee/users/43c73b75b75240848e9b51356d580617/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.046486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf9b3b-095d-4706-a7ed-dc18945777f8 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:17.047987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9669b7a93634363877de6eca3d523ee, user_id=43c73b75b75240848e9b51356d580617, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:17.051257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:17.051416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:17.051877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.052158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.052431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.053114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:17.054716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:17.067693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 953/1911] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:17.072006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:17.077570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 959/1912] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:16 2022] PUT /identity/v3/projects/c9669b7a93634363877de6eca3d523ee/users/43c73b75b75240848e9b51356d580617/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:17.081526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:17.090103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412f0f3-e6d4-41cb-938b-2cf82a9c5a6d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:17.151401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:17.218333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95c366-9a5f-44fc-9538-f699f4fe1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:17.219323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95c366-9a5f-44fc-9538-f699f4fe1119 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.219659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95c366-9a5f-44fc-9538-f699f4fe1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.219963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95c366-9a5f-44fc-9538-f699f4fe1119 admin admin] PATH_INFO: `/v3/projects/5b154ac828a44c40b751ddad9bef5592/users/82c2f58203734514bec2731287cb2253/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.222192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95c366-9a5f-44fc-9538-f699f4fe1119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b154ac828a44c40b751ddad9bef5592, user_id=82c2f58203734514bec2731287cb2253, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:17.225103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95c366-9a5f-44fc-9538-f699f4fe1119 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:17.225215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896a31d-99a3-40fa-b3e3-4759758770ed admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:17.235992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:17.236626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.236937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.237220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.238098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:17.239847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:17.255195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 954/1913] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:17 2022] PUT /identity/v3/projects/5b154ac828a44c40b751ddad9bef5592/users/82c2f58203734514bec2731287cb2253/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:17.256707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.257053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.257334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.261261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 960/1914] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:17.265557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:17.284974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74f7fe-b742-4bed-b076-9c9ef4d20d36 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:17.293970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] MFA Rules not processed for user `82c2f58203734514bec2731287cb2253`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:17.295317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:17.304933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:17.347702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f0202-8b15-407f-82b0-ad2412ecb782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:17.348796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0202-8b15-407f-82b0-ad2412ecb782 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.349380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0202-8b15-407f-82b0-ad2412ecb782 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.349843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0202-8b15-407f-82b0-ad2412ecb782 admin admin] PATH_INFO: `/v3/projects/c9669b7a93634363877de6eca3d523ee/users/43c73b75b75240848e9b51356d580617/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.352292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f0202-8b15-407f-82b0-ad2412ecb782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9669b7a93634363877de6eca3d523ee, user_id=43c73b75b75240848e9b51356d580617, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:17.355456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f0202-8b15-407f-82b0-ad2412ecb782 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:17.367748 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 961/1915] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:17 2022] PUT /identity/v3/projects/c9669b7a93634363877de6eca3d523ee/users/43c73b75b75240848e9b51356d580617/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:17.374882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 955/1916] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:17.378063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ce7f-da98-4d54-8fd0-7504ad224b38 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.378425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ce7f-da98-4d54-8fd0-7504ad224b38 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.378772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ce7f-da98-4d54-8fd0-7504ad224b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.386817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:17.388582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:17.414080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9e56ce7f-da98-4d54-8fd0-7504ad224b38 None None] MFA Rules not processed for user `43c73b75b75240848e9b51356d580617`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:17.415210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9e56ce7f-da98-4d54-8fd0-7504ad224b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:17.463611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c82ed-fb7d-4231-9336-ee2094946717 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:17.510271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 962/1917] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:17.519368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ce7f-da98-4d54-8fd0-7504ad224b38 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:17.523581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d78875-9812-4112-99b7-8bf6e784b335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:17.524071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d78875-9812-4112-99b7-8bf6e784b335 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.524351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d78875-9812-4112-99b7-8bf6e784b335 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.524637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d78875-9812-4112-99b7-8bf6e784b335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.534812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ce7f-da98-4d54-8fd0-7504ad224b38 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:17.540662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:17.541313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:17.541596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:17.541866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:17.551895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:17.553358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:17.563259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 963/1918] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:17.598067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d78875-9812-4112-99b7-8bf6e784b335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:17.599594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d78875-9812-4112-99b7-8bf6e784b335 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:17.610145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 956/1919] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:18.092216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:18.140542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:18.173697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667aed0-2a4e-40e8-a3b0-01d6dd3eccd9 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:18.179198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:18.179885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:18.180352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:18.180650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] PATH_INFO: `/v3/users/e2ac40095c3a4d53b093b97c5e446656` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:18.181800 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ac40095c3a4d53b093b97c5e446656)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:18.183737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:18.232604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ac40095c3a4d53b093b97c5e446656'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:18.233519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ac40095c3a4d53b093b97c5e446656'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:18.240865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ac40095c3a4d53b093b97c5e446656'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:18.249557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ac40095c3a4d53b093b97c5e446656'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:18.250190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ac40095c3a4d53b093b97c5e446656'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:18.269818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 964/1920] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:18 2022] DELETE /identity/v3/users/e2ac40095c3a4d53b093b97c5e446656 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:18.277744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:18.278221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:18.278313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:18.315485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:18.316834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:18.340138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:18.400699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 957/1921] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:18.410740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:18.412658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:18.504013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ebb7b-4663-4a5a-b5a5-7886121550d9 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:18.508556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:18.509306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:18.510369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:18.510369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:18.521874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:18.523421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:18.537099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 965/1922] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:18.934039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:18.935581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:18.948608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16618ac-f25b-4ddd-bbea-28a906e0e111 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:18.954698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:18.955476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:18.955763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:18.956096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] PATH_INFO: `/v3/projects/b6b190a746f947ff953e76599e2025dd` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:18.957325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b190a746f947ff953e76599e2025dd)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:18.959281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:19.013904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b190a746f947ff953e76599e2025dd', 'request_id': 'req-74523221-7026-4c59-bfbd-676e6b7a69b6'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.022486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b190a746f947ff953e76599e2025dd', 'request_id': 'req-74523221-7026-4c59-bfbd-676e6b7a69b6'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.028527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b190a746f947ff953e76599e2025dd', 'request_id': 'req-74523221-7026-4c59-bfbd-676e6b7a69b6'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.041603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] The token cache is being invalidate because project b6b190a746f947ff953e76599e2025dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:19.042090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.043243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.044117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:19.045094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 958/1923] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:18 2022] DELETE /identity/v3/projects/b6b190a746f947ff953e76599e2025dd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:19.045860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:19.048931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:19.050310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:19.110792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b0d3f-3e25-41cc-9b11-c7b08564e5a5 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:19.123172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74523221-7026-4c59-bfbd-676e6b7a69b6 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:19.125704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:19.128888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:19.129740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:19.130150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:19.130471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] PATH_INFO: `/v3/users/43c73b75b75240848e9b51356d580617` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:19.131824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c73b75b75240848e9b51356d580617)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:19.133954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:19.171574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06756d03-5990-4206-a1ab-0bdc5b48dec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:19.173021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756d03-5990-4206-a1ab-0bdc5b48dec2 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:19.173021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756d03-5990-4206-a1ab-0bdc5b48dec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:19.173194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06756d03-5990-4206-a1ab-0bdc5b48dec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:19.175616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-06756d03-5990-4206-a1ab-0bdc5b48dec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:19.204945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:19.210559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c73b75b75240848e9b51356d580617'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.211369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c73b75b75240848e9b51356d580617'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.221735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c73b75b75240848e9b51356d580617'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.222682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c73b75b75240848e9b51356d580617'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.241791 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c73b75b75240848e9b51356d580617'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.251079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06756d03-5990-4206-a1ab-0bdc5b48dec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:19.252637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06756d03-5990-4206-a1ab-0bdc5b48dec2 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:19.256803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 959/1924] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:19 2022] DELETE /identity/v3/users/43c73b75b75240848e9b51356d580617 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:19.257941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:19.259452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:19.263915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 966/1925] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:19.345628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b349206-fe0d-4459-ae38-a0343a0fb8a1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:19.352450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:19.352858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:19.353680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:19.353980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] PATH_INFO: `/v3/users/9db3ecb16e1f4c7ba648d6f6abee1d00` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:19.355163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db3ecb16e1f4c7ba648d6f6abee1d00)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:19.357740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:19.418147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db3ecb16e1f4c7ba648d6f6abee1d00'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.421898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db3ecb16e1f4c7ba648d6f6abee1d00'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.433733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db3ecb16e1f4c7ba648d6f6abee1d00'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.434445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db3ecb16e1f4c7ba648d6f6abee1d00'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.449494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db3ecb16e1f4c7ba648d6f6abee1d00'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:19.462883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 960/1926] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:19 2022] DELETE /identity/v3/users/9db3ecb16e1f4c7ba648d6f6abee1d00 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:19.467723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:19.468011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:19.468307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:19.490188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:19.491701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:19.570775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 967/1927] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:19.590549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:19.592490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:19.656073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:19.687950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded4eb0-6f7d-4844-b635-90c0f905427f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:19.694664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6e238-796f-4428-a802-a900f2cd815c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:19.695500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6e238-796f-4428-a802-a900f2cd815c service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:19.696030 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6e238-796f-4428-a802-a900f2cd815c service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:19.701030 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6e238-796f-4428-a802-a900f2cd815c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:19.725490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6e238-796f-4428-a802-a900f2cd815c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:19.727092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6e238-796f-4428-a802-a900f2cd815c service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:19.744802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 961/1928] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:19.947563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:19.952204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:19.965458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568c1a4-8bdc-413e-b188-08812af5d0a3 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:19.973229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:19.973660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:19.973941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:19.974263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] PATH_INFO: `/v3/projects/c9669b7a93634363877de6eca3d523ee` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:19.975344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9669b7a93634363877de6eca3d523ee)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:19.977356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.065984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9669b7a93634363877de6eca3d523ee', 'request_id': 'req-5db77d11-3f5e-41ef-bf89-936082abf31f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.082418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9669b7a93634363877de6eca3d523ee', 'request_id': 'req-5db77d11-3f5e-41ef-bf89-936082abf31f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.089196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9669b7a93634363877de6eca3d523ee', 'request_id': 'req-5db77d11-3f5e-41ef-bf89-936082abf31f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.091079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:20.106136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] The token cache is being invalidate because project c9669b7a93634363877de6eca3d523ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:20.106435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.107080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5db77d11-3f5e-41ef-bf89-936082abf31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.109444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 968/1929] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:19 2022] DELETE /identity/v3/projects/c9669b7a93634363877de6eca3d523ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:20.114346 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.114641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.114921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.136697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:20.137951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:20.212171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 962/1930] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:20.220957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c385110-3d68-48d6-b07c-17e6b66f3a36 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.221746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c385110-3d68-48d6-b07c-17e6b66f3a36 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.222035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c385110-3d68-48d6-b07c-17e6b66f3a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.238686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.240792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:20.247818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3c385110-3d68-48d6-b07c-17e6b66f3a36 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:20.249120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3c385110-3d68-48d6-b07c-17e6b66f3a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:20.255997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d6c55-d82f-4f76-83da-4ecd2bfaec1d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.261301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 969/1931] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:20.261803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.262861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c385110-3d68-48d6-b07c-17e6b66f3a36 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.263000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.263270 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.265363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] PATH_INFO: `/v3/projects/feb64b2ba2e74b81b915af0ebea22901` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.268379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb64b2ba2e74b81b915af0ebea22901)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.270830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.280225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c385110-3d68-48d6-b07c-17e6b66f3a36 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.285915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.286803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.287395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.287885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.288722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:20.289252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.291042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.304966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 970/1932] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:20.309509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.324722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9cda-1598-4b22-a257-3e9c6bb3526d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.331220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.331929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.332210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.332550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.333547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.335427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.356790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb64b2ba2e74b81b915af0ebea22901', 'request_id': 'req-ff9c501a-36bb-4501-b68e-090c1a83cae3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.367010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb64b2ba2e74b81b915af0ebea22901', 'request_id': 'req-ff9c501a-36bb-4501-b68e-090c1a83cae3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.371287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 971/1933] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:20 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:20.375246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb64b2ba2e74b81b915af0ebea22901', 'request_id': 'req-ff9c501a-36bb-4501-b68e-090c1a83cae3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.375715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.389928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] The token cache is being invalidate because project feb64b2ba2e74b81b915af0ebea22901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:20.390205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.391032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.392571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 963/1934] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:20 2022] DELETE /identity/v3/projects/feb64b2ba2e74b81b915af0ebea22901 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:20.396754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.399349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:20.472271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66835b-c9d6-4e85-9250-359a74de8776 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.478628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c501a-36bb-4501-b68e-090c1a83cae3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.484608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.485435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.485738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.485989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] PATH_INFO: `/v3/users/61bcad3dfc44475e8c32509c800230bc` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.487196 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bcad3dfc44475e8c32509c800230bc)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.489284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.495556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:20.501412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.503531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.503938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.504124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.504973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.509753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.558769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 972/1935] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:20 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:20.561928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bcad3dfc44475e8c32509c800230bc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.562875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.562974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bcad3dfc44475e8c32509c800230bc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.564856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:20.573917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bcad3dfc44475e8c32509c800230bc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.574750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bcad3dfc44475e8c32509c800230bc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.580619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a0a11-8031-48fe-b720-28552345e6d4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.589697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bcad3dfc44475e8c32509c800230bc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:20.601511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.602064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.602352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.602621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.604979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 964/1936] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:20 2022] DELETE /identity/v3/users/61bcad3dfc44475e8c32509c800230bc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:20.605110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.605375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.616933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 973/1937] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:20.622020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.708538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54276-830c-4a8d-9062-95d5e6f4764c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.715373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c445586-2fca-49e9-93ec-4ebee8fed7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.716004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c445586-2fca-49e9-93ec-4ebee8fed7da admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.716286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c445586-2fca-49e9-93ec-4ebee8fed7da admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.716618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c445586-2fca-49e9-93ec-4ebee8fed7da admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.717859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c445586-2fca-49e9-93ec-4ebee8fed7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.719518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c445586-2fca-49e9-93ec-4ebee8fed7da admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.731970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 965/1938] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:20.736228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:20.750618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a186b-acd3-433c-bdf5-cffba9a4de6b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:20.771311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:20.773649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.774031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.774405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] PATH_INFO: `/v3/projects/8d91ce5093e74d4797ef405c05afff85/users/af8eafab45da4bb3b7eea100be418148/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.802782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d91ce5093e74d4797ef405c05afff85, user_id=af8eafab45da4bb3b7eea100be418148, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:20.808018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:20.836727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 974/1939] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:20 2022] PUT /identity/v3/projects/8d91ce5093e74d4797ef405c05afff85/users/af8eafab45da4bb3b7eea100be418148/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:20.848383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436d4d0-fd5c-4ef6-914d-cb8547e54364 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:20.851791 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436d4d0-fd5c-4ef6-914d-cb8547e54364 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:20.852829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436d4d0-fd5c-4ef6-914d-cb8547e54364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:20.953251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0436d4d0-fd5c-4ef6-914d-cb8547e54364 None None] MFA Rules not processed for user `af8eafab45da4bb3b7eea100be418148`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:20.954524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0436d4d0-fd5c-4ef6-914d-cb8547e54364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:21.074550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.077229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 966/1940] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:21.172365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d999bb-7932-479f-b902-db489e805786 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.177884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.178507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.178786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.179260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.179908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.182620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.195422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:21.230560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 975/1941] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:21 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:21.235011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436d4d0-fd5c-4ef6-914d-cb8547e54364 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.237771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.240176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:21.253846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436d4d0-fd5c-4ef6-914d-cb8547e54364 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.274887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:21.348369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a854d2-3d6c-477b-b741-c5f690793807 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.352015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.352672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.352971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.353414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.353656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.353936 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.354218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.354317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.354545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] PATH_INFO: `/v3/projects/209463633267411b95a7b0995c6eedb7` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.355654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209463633267411b95a7b0995c6eedb7)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.356264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.357922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.379591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 967/1942] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:21 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:21.383212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.395477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8e99-d35d-452e-bb54-e81bd3812595 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.401481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.402160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.403188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.403595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.404252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.406826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.423211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 968/1943] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:21.424246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.434749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209463633267411b95a7b0995c6eedb7', 'request_id': 'req-2203fc9b-92fe-4a59-83f6-7726a8489885'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:21.439370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f4452-11ae-40fe-852d-60e9311ce808 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.443202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209463633267411b95a7b0995c6eedb7', 'request_id': 'req-2203fc9b-92fe-4a59-83f6-7726a8489885'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:21.449516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209463633267411b95a7b0995c6eedb7', 'request_id': 'req-2203fc9b-92fe-4a59-83f6-7726a8489885'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:21.465489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] The token cache is being invalidate because project 209463633267411b95a7b0995c6eedb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:21.465791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:21.466450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2203fc9b-92fe-4a59-83f6-7726a8489885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:21.475824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 976/1944] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:21 2022] DELETE /identity/v3/projects/209463633267411b95a7b0995c6eedb7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:21.475824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6f23-acd9-4022-90e8-de7f145fc5bf None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.475824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6f23-acd9-4022-90e8-de7f145fc5bf None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.475824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6f23-acd9-4022-90e8-de7f145fc5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.514646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ef0f6f23-acd9-4022-90e8-de7f145fc5bf None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:21.515913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ef0f6f23-acd9-4022-90e8-de7f145fc5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:21.527653 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.528329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.528610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.528884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] PATH_INFO: `/v3/projects/4f75ce10662c4faeb90669a34f52a3c3/users/56495345084343db8e840c4b2af354f0/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.553574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f75ce10662c4faeb90669a34f52a3c3, user_id=56495345084343db8e840c4b2af354f0, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.557272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.572659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 969/1945] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:21 2022] PUT /identity/v3/projects/4f75ce10662c4faeb90669a34f52a3c3/users/56495345084343db8e840c4b2af354f0/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:21.577446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.579795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:21.585005 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 977/1946] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:21.593033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c081-7c0d-4f9e-9f23-4ba5f89cdb13 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.593328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c081-7c0d-4f9e-9f23-4ba5f89cdb13 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.593604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c081-7c0d-4f9e-9f23-4ba5f89cdb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.617582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8548c081-7c0d-4f9e-9f23-4ba5f89cdb13 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:21.618771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8548c081-7c0d-4f9e-9f23-4ba5f89cdb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:21.633806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:21.659220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ead2a8-d136-47f9-8b33-f4d9fb0310da admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.665265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.665884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.666203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.666491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.667213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.668804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.684251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 970/1947] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:21.685350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.697713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c781905-7434-4055-b3f2-2ecacf1443e4 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.702533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f2d23-813f-4a0c-afa8-524015765f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.703209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2d23-813f-4a0c-afa8-524015765f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.703493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2d23-813f-4a0c-afa8-524015765f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.703770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f2d23-813f-4a0c-afa8-524015765f80 admin admin] PATH_INFO: `/v3/projects/4f75ce10662c4faeb90669a34f52a3c3/users/56495345084343db8e840c4b2af354f0/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.705707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f2d23-813f-4a0c-afa8-524015765f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f75ce10662c4faeb90669a34f52a3c3, user_id=56495345084343db8e840c4b2af354f0, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.706728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 978/1948] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:21.708361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f2d23-813f-4a0c-afa8-524015765f80 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.711761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:21.721100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 971/1949] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:21 2022] PUT /identity/v3/projects/4f75ce10662c4faeb90669a34f52a3c3/users/56495345084343db8e840c4b2af354f0/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:21.722944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c081-7c0d-4f9e-9f23-4ba5f89cdb13 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.733051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c081-7c0d-4f9e-9f23-4ba5f89cdb13 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.733309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.733602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.733948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.763228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] MFA Rules not processed for user `56495345084343db8e840c4b2af354f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:21.764603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:21.797370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.798008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.798220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.798543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.799426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:21.799736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.801436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.817627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 979/1950] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:21.819994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.831849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9fe4-0855-48e7-8224-e8bc397dbd45 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:21.837171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:21.838022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:21.838308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:21.838589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:21.839400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:21.841974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:21.847767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 972/1951] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:21.860356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.864034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:21.888502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 980/1952] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:21 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:21.894831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:21.966431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95766d67-5e3f-4474-bad5-de64936085e4 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:22.046613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5e585-7bff-473a-b109-4ca2b1a34907 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:22.066999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:22.067720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:22.068076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:22.068418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:22.075003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:22.075965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:22.076839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:22.077429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:22.077566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:22.078259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:22.080226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:22.127997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 981/1953] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:21 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:22.132010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:22.164046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824297aa-9168-42dd-803c-19abd9ec8cf3 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:22.176672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:22.177337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:22.177620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:22.177895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:22.178544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:22.182789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:22.207900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:22.208856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 982/1954] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:22.213157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:22.234343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:22.235734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbcd06-7649-4fc2-a92c-2c5a98b2b55f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:22.237984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:22.246918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c55f-a561-4895-9fa6-7265d9a4c562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:22.248706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c55f-a561-4895-9fa6-7265d9a4c562 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:22.249025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c55f-a561-4895-9fa6-7265d9a4c562 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:22.249303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c55f-a561-4895-9fa6-7265d9a4c562 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:22.251425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c55f-a561-4895-9fa6-7265d9a4c562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:22.256606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c55f-a561-4895-9fa6-7265d9a4c562 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:22.273832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 973/1955] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:22.281318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:22.310522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 983/1956] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:22.310949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:22.328712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0a432-d95b-46be-8da1-8f0aaf672ad3 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:22.353543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:22.354757 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:22.358235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:22.358549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] PATH_INFO: `/v3/projects/d9008ca15ba3462d8d053fbbb7f4b522/users/3f5c54518155494591129fffaeeab9a1/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:22.398145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9008ca15ba3462d8d053fbbb7f4b522, user_id=3f5c54518155494591129fffaeeab9a1, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:22.401282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:22.424973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 974/1957] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:22 2022] PUT /identity/v3/projects/d9008ca15ba3462d8d053fbbb7f4b522/users/3f5c54518155494591129fffaeeab9a1/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:22.437606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1f19-3d4a-4017-96ed-3cc9813096af None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:22.438140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1f19-3d4a-4017-96ed-3cc9813096af None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:22.438490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1f19-3d4a-4017-96ed-3cc9813096af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:22.529047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5e5b1f19-3d4a-4017-96ed-3cc9813096af None None] MFA Rules not processed for user `3f5c54518155494591129fffaeeab9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:22.529047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5e5b1f19-3d4a-4017-96ed-3cc9813096af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:22.685192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 984/1958] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:22.829126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:22.830989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:22.908413 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f7cff-3c8e-4f24-93bb-3658e3935f60 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:22.917229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255d388-2fcf-4fd5-8d7a-621a402e2b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:22.918083 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d388-2fcf-4fd5-8d7a-621a402e2b1c service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:22.918541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d388-2fcf-4fd5-8d7a-621a402e2b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:22.918769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d388-2fcf-4fd5-8d7a-621a402e2b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:22.929967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255d388-2fcf-4fd5-8d7a-621a402e2b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:22.937600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255d388-2fcf-4fd5-8d7a-621a402e2b1c service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:22.947326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 975/1959] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:22.972407 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1f19-3d4a-4017-96ed-3cc9813096af None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:23.062555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1f19-3d4a-4017-96ed-3cc9813096af None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:23.067498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:23.068302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.068589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.069047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] PATH_INFO: `/v3/users/3f5c54518155494591129fffaeeab9a1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.070734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5c54518155494591129fffaeeab9a1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:23.072832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:23.137304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5c54518155494591129fffaeeab9a1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.138116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5c54518155494591129fffaeeab9a1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.147851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5c54518155494591129fffaeeab9a1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.162996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5c54518155494591129fffaeeab9a1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.163881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5c54518155494591129fffaeeab9a1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.188103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 985/1960] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:22 2022] DELETE /identity/v3/users/3f5c54518155494591129fffaeeab9a1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:23.192901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.193224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.193533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.219134 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:23.220537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.290977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 976/1961] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:23.295521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:23.296964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.301456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:23.302781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.310241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526f4b-6170-4b41-a734-1dd5c0276638 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:23.314959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:23.315536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.315824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.316100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] PATH_INFO: `/v3/users/72e8079cb3bd4a0aaca4677a1dd7f66a` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.317273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e8079cb3bd4a0aaca4677a1dd7f66a)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:23.319213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:23.321823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:23.362737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3610fc-ce61-428f-b2df-1414e40991ea None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:23.369790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:23.372761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.373061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.373368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.387878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e8079cb3bd4a0aaca4677a1dd7f66a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.389265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e8079cb3bd4a0aaca4677a1dd7f66a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.391987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:23.393989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:23.398289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e8079cb3bd4a0aaca4677a1dd7f66a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.411655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e8079cb3bd4a0aaca4677a1dd7f66a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.411910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 977/1962] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:23.412906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:23.413112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e1b79e5-8948-4134-94dc-9de44de3037a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e8079cb3bd4a0aaca4677a1dd7f66a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.414226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.433850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 986/1963] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:23 2022] DELETE /identity/v3/users/72e8079cb3bd4a0aaca4677a1dd7f66a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:23.435503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e19f3-1dd8-4fc6-902f-7ebbb004470c service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:23.439126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.440038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.440379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.447266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:23.475027 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:23.477052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.517036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:23.517809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.518095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.518374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] PATH_INFO: `/v3/users/6f3d8f46f117478887f9d0c082053266` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.519532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3d8f46f117478887f9d0c082053266)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:23.521648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:23.551922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 987/1964] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:23.564592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:23.566269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.585204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3d8f46f117478887f9d0c082053266'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.585941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3d8f46f117478887f9d0c082053266'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.595997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3d8f46f117478887f9d0c082053266'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.596693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3d8f46f117478887f9d0c082053266'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.617969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-2821263b-5999-4f15-995c-98b296c11d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3d8f46f117478887f9d0c082053266'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:23.638909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 978/1965] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:23 2022] DELETE /identity/v3/users/6f3d8f46f117478887f9d0c082053266 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:23.643618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.644045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.644460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.644570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5342f8-2d4f-4b9f-a85c-effef2882767 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:23.671714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:23.673058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.707257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:23.737166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8ef55-e534-447b-83f7-921ee92e7afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:23.738154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ef55-e534-447b-83f7-921ee92e7afd service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.738441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ef55-e534-447b-83f7-921ee92e7afd service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.738708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8ef55-e534-447b-83f7-921ee92e7afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.741497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cfb8ef55-e534-447b-83f7-921ee92e7afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.757275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 979/1966] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:23.771729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:23.778552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:23.796597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a633a-2d0b-4572-b5b1-3c4f2641967e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:23.800354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:23.802210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:23.802210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:23.802408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:23.814078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:23.815776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:23.830082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 980/1967] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:23.836194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8ef55-e534-447b-83f7-921ee92e7afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:23.838029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8ef55-e534-447b-83f7-921ee92e7afd service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:23.851326 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 988/1968] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:24.136693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:24.141533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.156674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3a3f1-c0ef-4a98-84b1-40b10e79f614 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:24.168801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:24.169610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:24.169972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:24.171323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] PATH_INFO: `/v3/projects/d9008ca15ba3462d8d053fbbb7f4b522` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:24.173405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9008ca15ba3462d8d053fbbb7f4b522)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:24.175490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:24.201847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:24.256331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9008ca15ba3462d8d053fbbb7f4b522', 'request_id': 'req-a8028e47-c86a-426a-a957-54bff099576d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.268845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9008ca15ba3462d8d053fbbb7f4b522', 'request_id': 'req-a8028e47-c86a-426a-a957-54bff099576d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.276690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9008ca15ba3462d8d053fbbb7f4b522', 'request_id': 'req-a8028e47-c86a-426a-a957-54bff099576d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.295429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] The token cache is being invalidate because project d9008ca15ba3462d8d053fbbb7f4b522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:24.296017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.296882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.299248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 981/1969] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:24 2022] DELETE /identity/v3/projects/d9008ca15ba3462d8d053fbbb7f4b522 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:24.304046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:24.304333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:24.304614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:24.346127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:24.348354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.408217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:24.409753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.522422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 989/1970] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:24.522422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:24.522422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.534625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67879a-9544-4429-b117-17172d1fff06 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:24.536117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028e47-c86a-426a-a957-54bff099576d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:24.542595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:24.543582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:24.543969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:24.544504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] PATH_INFO: `/v3/projects/c47e68df65d94da3b214aaddfdf9336a` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:24.546301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47e68df65d94da3b214aaddfdf9336a)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:24.548493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:24.564248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:24.565268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:24.565742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:24.566325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] PATH_INFO: `/v3/projects/c747fb00bda94f56aad1c382db1fa826` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:24.567804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c747fb00bda94f56aad1c382db1fa826)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:24.570852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:24.637266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c747fb00bda94f56aad1c382db1fa826', 'request_id': 'req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.646403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c747fb00bda94f56aad1c382db1fa826', 'request_id': 'req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.655578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c747fb00bda94f56aad1c382db1fa826', 'request_id': 'req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.676525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47e68df65d94da3b214aaddfdf9336a', 'request_id': 'req-8b6086d9-181a-4d51-906f-2cb144755945'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.677509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] The token cache is being invalidate because project c747fb00bda94f56aad1c382db1fa826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:24.677875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.679454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cf5d7f4b-9713-46c9-8ca7-82df2434fc76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.681684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 990/1971] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:24 2022] DELETE /identity/v3/projects/c747fb00bda94f56aad1c382db1fa826 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:24.683202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:24.683719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:24.684136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:24.690712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47e68df65d94da3b214aaddfdf9336a', 'request_id': 'req-8b6086d9-181a-4d51-906f-2cb144755945'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.700231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47e68df65d94da3b214aaddfdf9336a', 'request_id': 'req-8b6086d9-181a-4d51-906f-2cb144755945'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.713978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] The token cache is being invalidate because project c47e68df65d94da3b214aaddfdf9336a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:24.714275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.714940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.715653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:24.717211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.720570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 982/1972] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:24 2022] DELETE /identity/v3/projects/c47e68df65d94da3b214aaddfdf9336a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:24.723457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:24.726113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.727891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:24.783439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:24.821876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6086d9-181a-4d51-906f-2cb144755945 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:24.828067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:24.828876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:24.829196 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:24.829504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] PATH_INFO: `/v3/users/896e24aefb724d53bebea9fa0ccb2b93` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:24.830715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896e24aefb724d53bebea9fa0ccb2b93)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:24.832687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:24.836816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 991/1973] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:24.837836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:24.839271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.851992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5147c-1feb-499b-9df2-ce5276d45a73 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:24.857996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:24.861850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:24.862739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:24.863163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] PATH_INFO: `/v3/users/82c2f58203734514bec2731287cb2253` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:24.864244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c2f58203734514bec2731287cb2253)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:24.866434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:24.890827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896e24aefb724d53bebea9fa0ccb2b93'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.891764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896e24aefb724d53bebea9fa0ccb2b93'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.901526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896e24aefb724d53bebea9fa0ccb2b93'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.902787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896e24aefb724d53bebea9fa0ccb2b93'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.924512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896e24aefb724d53bebea9fa0ccb2b93'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.924991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c2f58203734514bec2731287cb2253'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.925771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c2f58203734514bec2731287cb2253'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.935004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c2f58203734514bec2731287cb2253'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.946104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 983/1974] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:24 2022] DELETE /identity/v3/users/896e24aefb724d53bebea9fa0ccb2b93 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:24.946990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:24.950813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c2f58203734514bec2731287cb2253'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.952799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c2f58203734514bec2731287cb2253'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:24.975227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:24.977316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 992/1975] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:24 2022] DELETE /identity/v3/users/82c2f58203734514bec2731287cb2253 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:25.117723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a2444-f6a4-400f-a15b-8a54196eafc2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.213672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:25.214381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.214723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.215847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.216513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:25.217335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:25.222200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:25.225709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:25.244165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 984/1976] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:25.250567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:25.252653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:25.269699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498a5a8-dcd0-4f9d-a3f3-7dd34deeaec4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.274681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:25.275709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.275890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.276158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.278849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:25.280535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:25.320949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 993/1977] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:25 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:25.322101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:25.333210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef3368-f706-426d-bcd6-76752b9049ba admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.408548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:25.409319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.409598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.409876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.410517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:25.412476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:25.445612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 985/1978] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:25 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:25.453107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:25.464667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f243e-558d-460b-af55-4681d639a64f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.469604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:25.470235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.470515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.470789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.471448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:25.473126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:25.488686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 994/1979] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:25.489992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:25.501265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8be96-34e3-4f03-975b-21aec79038d0 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.506922 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7354f-3f95-4765-8775-73e1eb7a70d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:25.507561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7354f-3f95-4765-8775-73e1eb7a70d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.507849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7354f-3f95-4765-8775-73e1eb7a70d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.508121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7354f-3f95-4765-8775-73e1eb7a70d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.508789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7354f-3f95-4765-8775-73e1eb7a70d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:25.511253 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7354f-3f95-4765-8775-73e1eb7a70d9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:25.526324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 986/1980] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:25.530727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:25.544672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ec930-6ad4-467a-a307-d5928ff6b5f3 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.553178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:25.554093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.554276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.554706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] PATH_INFO: `/v3/projects/c48f6ba8381c4bc7934b85d6cb019a02/users/a757a294c21348169ad3364176c020f3/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.589856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48f6ba8381c4bc7934b85d6cb019a02, user_id=a757a294c21348169ad3364176c020f3, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:25.593652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:25.620847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 995/1981] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:25 2022] PUT /identity/v3/projects/c48f6ba8381c4bc7934b85d6cb019a02/users/a757a294c21348169ad3364176c020f3/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:25.627072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.627628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.627967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.661514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:25.666405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:25.812511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 987/1982] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:25.825864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:25.828112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:25.883696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:25.935253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f91d-e7ac-4cfe-91c3-bad72f766dcc admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.941299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:25.941994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:25.942475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:25.942576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:25.946010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:25.947398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:25.986597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cb340-1c93-4735-9f91-66430a6b424e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:25.990278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:25.990955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:26.005518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:26.006180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.006458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.007664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] PATH_INFO: `/v3/projects/efa7883358fe4262bcd51a619283d833` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.010007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa7883358fe4262bcd51a619283d833)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:26.012008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:26.026623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 996/1983] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:26.119752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa7883358fe4262bcd51a619283d833', 'request_id': 'req-4b5382f1-7d82-4785-b831-56ad473bfc6e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.137488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa7883358fe4262bcd51a619283d833', 'request_id': 'req-4b5382f1-7d82-4785-b831-56ad473bfc6e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.150146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa7883358fe4262bcd51a619283d833', 'request_id': 'req-4b5382f1-7d82-4785-b831-56ad473bfc6e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.153408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:26.159214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:26.169563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:26.191287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] The token cache is being invalidate because project efa7883358fe4262bcd51a619283d833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:26.191634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.192443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4b5382f1-7d82-4785-b831-56ad473bfc6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.195310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 988/1984] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:25 2022] DELETE /identity/v3/projects/efa7883358fe4262bcd51a619283d833 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:26.196117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e233f-eb3f-4e31-a978-b4a23e5dc780 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:26.201845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da759a7a-7bf8-4566-af76-ac88e8fa6dcd None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.203133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da759a7a-7bf8-4566-af76-ac88e8fa6dcd None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.203483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da759a7a-7bf8-4566-af76-ac88e8fa6dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.259057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-da759a7a-7bf8-4566-af76-ac88e8fa6dcd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:26.260685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-da759a7a-7bf8-4566-af76-ac88e8fa6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:26.345706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 989/1985] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:26.355711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7babb-2844-4d39-a8ef-6dbff061884f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.356004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7babb-2844-4d39-a8ef-6dbff061884f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.356284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7babb-2844-4d39-a8ef-6dbff061884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.405226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:26.406053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.406429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.408136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] PATH_INFO: `/v3/projects/5b154ac828a44c40b751ddad9bef5592` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.410531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b154ac828a44c40b751ddad9bef5592)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:26.415841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:26.431826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-70d7babb-2844-4d39-a8ef-6dbff061884f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:26.434612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-70d7babb-2844-4d39-a8ef-6dbff061884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:26.458558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 990/1986] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:26.462835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7babb-2844-4d39-a8ef-6dbff061884f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:26.491273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7babb-2844-4d39-a8ef-6dbff061884f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:26.517583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:26.518687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.518801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.520962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.522782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:26.524420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:26.531459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:26.556902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b154ac828a44c40b751ddad9bef5592', 'request_id': 'req-02f035de-374e-4f4e-bd07-62c56f9ff984'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.565013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b154ac828a44c40b751ddad9bef5592', 'request_id': 'req-02f035de-374e-4f4e-bd07-62c56f9ff984'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.567562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 991/1987] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:26.571940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b154ac828a44c40b751ddad9bef5592', 'request_id': 'req-02f035de-374e-4f4e-bd07-62c56f9ff984'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.572399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:26.596479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c2caf-d8d1-4cae-b737-0be118adc51f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:26.598885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] The token cache is being invalidate because project 5b154ac828a44c40b751ddad9bef5592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:26.599566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.600381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-02f035de-374e-4f4e-bd07-62c56f9ff984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:26.604500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 997/1988] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:26 2022] DELETE /identity/v3/projects/5b154ac828a44c40b751ddad9bef5592 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:26.612806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed4dad-7aae-4ee6-a318-51585b635821 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.613262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed4dad-7aae-4ee6-a318-51585b635821 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.613695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed4dad-7aae-4ee6-a318-51585b635821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.642077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-36ed4dad-7aae-4ee6-a318-51585b635821 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:26.643607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-36ed4dad-7aae-4ee6-a318-51585b635821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:26.678952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:26.687439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.687899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.688586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.689517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:26.696180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:26.769534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 992/1989] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:26 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:26.770993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:26.774112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:26.775454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:26.801385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 998/1990] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:26.805122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f76f-0c1e-41d6-a387-b550961177b9 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.806547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f76f-0c1e-41d6-a387-b550961177b9 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.806853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f76f-0c1e-41d6-a387-b550961177b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.861761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8f68f76f-0c1e-41d6-a387-b550961177b9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:26.863764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8f68f76f-0c1e-41d6-a387-b550961177b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:26.907193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ad52-b447-40c2-82b0-4f32e48c0796 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:26.923206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:26.924384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.924671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.925260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.926054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:26.929243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:26.945651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:26.952963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 999/1991] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:26.954912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f76f-0c1e-41d6-a387-b550961177b9 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:26.969653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f76f-0c1e-41d6-a387-b550961177b9 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:26.977164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 993/1992] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:26 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:26.987522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:26.990581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:26.991337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:26.991621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:26.991891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:26.992970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:26.993488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:26.995444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:26.999044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f5cb2-9120-450d-a692-96ea9d5e2bbb admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.003687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.004298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.004581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.005112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.005842 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.007705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.014912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1000/1993] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:50:27.021653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.027158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 994/1994] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:27.028254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.042349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54db1-1531-4c7f-9b9c-a4fcd6a42500 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.044761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffc18e-75a5-45d7-a57a-3ba2780cb004 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.048943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.050060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.050443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.050979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.051157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.051484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.051760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.052164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.052513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.053239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.054455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.055593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.069573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 995/1995] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:27.074451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.085757 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1367-0b5e-46b8-a5d1-4793caf45975 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.090784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7563cf4-9054-4f82-98d5-2564864018e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.091453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563cf4-9054-4f82-98d5-2564864018e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.091733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563cf4-9054-4f82-98d5-2564864018e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.093069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563cf4-9054-4f82-98d5-2564864018e4 admin admin] PATH_INFO: `/v3/projects/558a927f21c14d678684c61809bf957e/users/17b8943f6f9946f1b150046b9455ca50/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.098093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1001/1996] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:27 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:27.105962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.114672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7563cf4-9054-4f82-98d5-2564864018e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558a927f21c14d678684c61809bf957e, user_id=17b8943f6f9946f1b150046b9455ca50, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.118151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7563cf4-9054-4f82-98d5-2564864018e4 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.147294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 996/1997] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:27 2022] PUT /identity/v3/projects/558a927f21c14d678684c61809bf957e/users/17b8943f6f9946f1b150046b9455ca50/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:27.150035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5b74-ee14-4106-81b1-98dafe3b8f53 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.150277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5b74-ee14-4106-81b1-98dafe3b8f53 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.150764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5b74-ee14-4106-81b1-98dafe3b8f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.203276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e834f0b-0549-484d-b489-6ed2ed8ae4ab admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.204522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2f9d5b74-ee14-4106-81b1-98dafe3b8f53 None None] MFA Rules not processed for user `17b8943f6f9946f1b150046b9455ca50`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:27.205806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2f9d5b74-ee14-4106-81b1-98dafe3b8f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:27.274473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.275578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.276560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.276843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.277594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.280160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.283445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 997/1998] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:27.287644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5b74-ee14-4106-81b1-98dafe3b8f53 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.298760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5b74-ee14-4106-81b1-98dafe3b8f53 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.303363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.303978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.304254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.304521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.305180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.307202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.307647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1002/1999] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:27 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:27.311248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.318591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:27.325619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580e7a6-81c3-4dd7-a1b4-87e5320946aa admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.333100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.333762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.334050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.334331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.334984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.336608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.340727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 998/2000] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:27 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:27.344785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.349086 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1003/2001] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:27.354048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.365273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8dc25-3c57-48ac-bea1-8ed804968744 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.418516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1297b75-2a29-4f60-8bb1-f170cd6454c9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.423833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.424686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.425005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.425276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.425912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.427058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.427676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.427973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.428088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.428260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.428871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.430599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.445050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1004/2002] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:27.447666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.462866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 999/2003] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:27 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:27.468112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.476269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3855-3f21-422b-8600-e3d6fa4983cf admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.482165 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:27.488152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.492009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.492155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.492359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] PATH_INFO: `/v3/projects/4ced036b89d54bca9c6b3344daab3dc6/users/fd1527ed331941f3961495b65de032f4/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.495746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20523d4d-01a5-4b20-9e24-cdcc6f1084c4 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.510792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4b9a4-e172-4a4b-8618-723df9207d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.513556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b9a4-e172-4a4b-8618-723df9207d21 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.513959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b9a4-e172-4a4b-8618-723df9207d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.514227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b9a4-e172-4a4b-8618-723df9207d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.514891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4b9a4-e172-4a4b-8618-723df9207d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.518466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4b9a4-e172-4a4b-8618-723df9207d21 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.534544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ced036b89d54bca9c6b3344daab3dc6, user_id=fd1527ed331941f3961495b65de032f4, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.537796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.542610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1000/2004] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:27.543910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34640a-c589-4f4e-b1d0-a82eb09c65c3 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.544194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34640a-c589-4f4e-b1d0-a82eb09c65c3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.544493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34640a-c589-4f4e-b1d0-a82eb09c65c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.581233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1005/2005] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:27 2022] PUT /identity/v3/projects/4ced036b89d54bca9c6b3344daab3dc6/users/fd1527ed331941f3961495b65de032f4/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:27.581233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.629490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0a34640a-c589-4f4e-b1d0-a82eb09c65c3 None None] MFA Rules not processed for user `a757a294c21348169ad3364176c020f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:27.631185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0a34640a-c589-4f4e-b1d0-a82eb09c65c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:27.681165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be1cd-f018-47f2-8273-a1a089b839cd admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.708660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.711328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.713671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.714502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] PATH_INFO: `/v3/projects/65a262515e574a6b86f64194fe1e07f3/users/198ba8f48dbf4aa3a9e82e453eaa779a/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.742078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a262515e574a6b86f64194fe1e07f3, user_id=198ba8f48dbf4aa3a9e82e453eaa779a, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.746458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:27.753343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1001/2006] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:27.756430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.756964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.767615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.771451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1006/2007] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:27 2022] PUT /identity/v3/projects/65a262515e574a6b86f64194fe1e07f3/users/198ba8f48dbf4aa3a9e82e453eaa779a/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:27.772474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.774511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:27.812656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] MFA Rules not processed for user `fd1527ed331941f3961495b65de032f4`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:27.814588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:27.880944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:27.889775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c83fb-52a9-4a79-8cb0-ca98bf78c7cf admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.894953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.895964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.896383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.896720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.898706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:27.929681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1002/2008] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:27.930966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:27.932429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:27.945807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6405810-a7a1-4e7e-bb25-17de1570be1f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:27.950946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:27.951835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:27.952274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:27.963538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:27.987309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:27.990074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.014442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1007/2009] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:28.015858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.085608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.088518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.102676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1003/2010] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:28.103830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.118591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33812b3f-b2fd-451f-8134-dfce537812a2 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.120417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8b03-7b39-4577-a07f-5c1bffee000f service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.127152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.127770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.128575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.128846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.131227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.132232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.133016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.133295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.133564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.134210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.135820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.138223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.153365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:28.163209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1008/2011] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:28.168719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.186025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dca521-06f2-4f6e-929f-2ae12868bb25 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.196990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1004/2012] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:28 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:28.198927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.200460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82440ae-4e63-4c44-b78e-c5774766a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.201244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82440ae-4e63-4c44-b78e-c5774766a2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.203097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82440ae-4e63-4c44-b78e-c5774766a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.203392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82440ae-4e63-4c44-b78e-c5774766a2c5 admin admin] PATH_INFO: `/v3/projects/65a262515e574a6b86f64194fe1e07f3/users/198ba8f48dbf4aa3a9e82e453eaa779a/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.208967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82440ae-4e63-4c44-b78e-c5774766a2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a262515e574a6b86f64194fe1e07f3, user_id=198ba8f48dbf4aa3a9e82e453eaa779a, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.211547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82440ae-4e63-4c44-b78e-c5774766a2c5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.236353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1009/2013] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:28 2022] PUT /identity/v3/projects/65a262515e574a6b86f64194fe1e07f3/users/198ba8f48dbf4aa3a9e82e453eaa779a/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:28.252650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72d5d-846a-49a2-9851-3e733ebff77f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.252942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72d5d-846a-49a2-9851-3e733ebff77f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.253238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72d5d-846a-49a2-9851-3e733ebff77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.318794 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-fed72d5d-846a-49a2-9851-3e733ebff77f None None] MFA Rules not processed for user `198ba8f48dbf4aa3a9e82e453eaa779a`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:28.320025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fed72d5d-846a-49a2-9851-3e733ebff77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:28.325017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae44a14-755e-435e-abaa-e26ac28c7938 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.471950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1010/2014] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:28.509765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.512223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.512599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.514095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.514844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.518722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.572522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72d5d-846a-49a2-9851-3e733ebff77f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.573921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1005/2015] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:28 2022] POST /identity/v3/users => generated 290 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:28.578383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.582072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:28.603849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574a7c0-4158-4606-bb3f-a55d9f4a9729 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.619860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.620606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.620971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.621448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.622187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.627023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.649256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1006/2016] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:28.653486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.658163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72d5d-846a-49a2-9851-3e733ebff77f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.663625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.664389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.664678 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.665290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9ab1a-1f5c-474a-889d-def53689aec1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.665788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.671241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.672010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.672350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.672701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.673438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.675182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.689220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.689220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.703975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1011/2017] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:28.710054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1007/2018] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:28.710202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.725207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeed065-9097-402b-9aae-b052144d376d service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.732782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dadff-7f8d-44f0-ade8-b8bc5186413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.733585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dadff-7f8d-44f0-ade8-b8bc5186413b admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.733959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dadff-7f8d-44f0-ade8-b8bc5186413b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.734249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dadff-7f8d-44f0-ade8-b8bc5186413b admin admin] PATH_INFO: `/v3/projects/ed6cbbe4ecc54611895fc7fe4c364c27/users/7fb17d426d0040db8c572b04050ed0c2/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.765647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dadff-7f8d-44f0-ade8-b8bc5186413b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6cbbe4ecc54611895fc7fe4c364c27, user_id=7fb17d426d0040db8c572b04050ed0c2, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.766979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.768656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dadff-7f8d-44f0-ade8-b8bc5186413b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.781853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b388c-f5ff-4763-9457-ccc8a7feacb1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:28.786524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1012/2019] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:28 2022] PUT /identity/v3/projects/ed6cbbe4ecc54611895fc7fe4c364c27/users/7fb17d426d0040db8c572b04050ed0c2/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:28.797784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0003f-8f6f-4b8c-82c2-430ab05d806a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.798074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0003f-8f6f-4b8c-82c2-430ab05d806a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.798351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0003f-8f6f-4b8c-82c2-430ab05d806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.831607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-96c0003f-8f6f-4b8c-82c2-430ab05d806a None None] MFA Rules not processed for user `7fb17d426d0040db8c572b04050ed0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:28.832904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-96c0003f-8f6f-4b8c-82c2-430ab05d806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:28.860629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:28.861401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:28.861679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:28.862013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:28.879721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:28.964874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:28.966618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:28.977580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1013/2020] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:28.979373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0003f-8f6f-4b8c-82c2-430ab05d806a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:28.982664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1008/2021] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:29.075090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0003f-8f6f-4b8c-82c2-430ab05d806a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:29.081444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:29.082751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.083446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.083446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.083938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:29.087724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:29.115788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:29.125676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1014/2022] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:28 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:29.129695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:29.143478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b0f88-3870-4af3-94a1-2b17d44aa6ad service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:29.249219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:29.251587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.252245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.252764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.253717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:29.255785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:29.291155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1009/2023] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:29 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:29.291655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:29.307619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f6255-8792-4bc3-8044-f9cdef3398a4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:29.317675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:29.318522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.318841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.319144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.319833 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:29.321631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:29.335405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1015/2024] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:29.339637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:29.366313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1871f0-704c-4383-9f7e-3665369be10f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:29.377179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:29.377941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.378995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.395515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] PATH_INFO: `/v3/projects/e4c993af510d4050be93134f460e113d/users/9179ae41474a4f49983ddacc62b15cf7/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.443359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c993af510d4050be93134f460e113d, user_id=9179ae41474a4f49983ddacc62b15cf7, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:29.454726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:29.509670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1010/2025] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:29 2022] PUT /identity/v3/projects/e4c993af510d4050be93134f460e113d/users/9179ae41474a4f49983ddacc62b15cf7/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:29.510849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:29.527813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010a91f-2b0d-4858-ba9c-7d08a76bd8f7 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:29.682922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa46fe5-0f62-4621-ba4d-0e5db765de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:29.683979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa46fe5-0f62-4621-ba4d-0e5db765de26 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.684173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa46fe5-0f62-4621-ba4d-0e5db765de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.684453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa46fe5-0f62-4621-ba4d-0e5db765de26 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.686249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa46fe5-0f62-4621-ba4d-0e5db765de26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:29.688178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa46fe5-0f62-4621-ba4d-0e5db765de26 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:29.704994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1016/2026] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:29.706714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:29.725191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81593b86-bc3c-4b18-9850-a56cea63c968 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:29.751776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b567c-c650-4c06-8fb9-a68750bdc247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:29.752485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b567c-c650-4c06-8fb9-a68750bdc247 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.752766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b567c-c650-4c06-8fb9-a68750bdc247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.753076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b567c-c650-4c06-8fb9-a68750bdc247 admin admin] PATH_INFO: `/v3/projects/e4c993af510d4050be93134f460e113d/users/9179ae41474a4f49983ddacc62b15cf7/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.755208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b567c-c650-4c06-8fb9-a68750bdc247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c993af510d4050be93134f460e113d, user_id=9179ae41474a4f49983ddacc62b15cf7, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:29.757926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b567c-c650-4c06-8fb9-a68750bdc247 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:29.771167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1011/2027] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:29 2022] PUT /identity/v3/projects/e4c993af510d4050be93134f460e113d/users/9179ae41474a4f49983ddacc62b15cf7/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:29.790262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0a0f-4576-4927-8462-8ab8aefc031f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.790580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0a0f-4576-4927-8462-8ab8aefc031f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.790828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f0a0f-4576-4927-8462-8ab8aefc031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.798338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a2c3-a632-43a6-96ee-022770236204 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:29.798866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a2c3-a632-43a6-96ee-022770236204 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:29.799147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a2c3-a632-43a6-96ee-022770236204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:29.833340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4af3a2c3-a632-43a6-96ee-022770236204 None None] MFA Rules not processed for user `a757a294c21348169ad3364176c020f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:29.833340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4af3a2c3-a632-43a6-96ee-022770236204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:29.846747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-403f0a0f-4576-4927-8462-8ab8aefc031f None None] MFA Rules not processed for user `9179ae41474a4f49983ddacc62b15cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:29.848534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-403f0a0f-4576-4927-8462-8ab8aefc031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:29.995861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1012/2028] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:30.062222 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1017/2029] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:30.076201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3a2c3-a632-43a6-96ee-022770236204 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:30.110265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:30.243447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3a2c3-a632-43a6-96ee-022770236204 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:30.247570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:30.248260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:30.248539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:30.248810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:30.269860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:30.271630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:30.289782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1013/2030] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:30.341777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0a0f-4576-4927-8462-8ab8aefc031f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:30.352161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f0a0f-4576-4927-8462-8ab8aefc031f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:30.356602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d4769-69f8-4a88-9d0c-36b3f4776672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:30.357471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d4769-69f8-4a88-9d0c-36b3f4776672 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:30.357730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d4769-69f8-4a88-9d0c-36b3f4776672 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:30.358574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d4769-69f8-4a88-9d0c-36b3f4776672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:30.437812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d4769-69f8-4a88-9d0c-36b3f4776672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:30.439600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d4769-69f8-4a88-9d0c-36b3f4776672 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:30.450009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1018/2031] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:32.759668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:32.761231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:32.861495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5d9e8-4e99-4724-bd45-6fdf19745dcb service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:32.867894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:32.868793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:32.869113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:32.869391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] PATH_INFO: `/v3/users/af8eafab45da4bb3b7eea100be418148` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:32.870914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8eafab45da4bb3b7eea100be418148)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:32.872835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:32.974013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8eafab45da4bb3b7eea100be418148'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:32.975492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8eafab45da4bb3b7eea100be418148'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:32.990131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8eafab45da4bb3b7eea100be418148'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:32.993117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8eafab45da4bb3b7eea100be418148'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:33.032796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8eafab45da4bb3b7eea100be418148'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:33.095495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1014/2032] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:32 2022] DELETE /identity/v3/users/af8eafab45da4bb3b7eea100be418148 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:33.099961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:33.100506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:33.100506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:33.121992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:33.135828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:33.140046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:33.303440 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1019/2033] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:33.347874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:33.349931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:33.464158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:33.466035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:33.468641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:33.498502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041fa16-51c6-4788-b5d8-3041bf43bf06 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:33.508433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:33.509250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:33.509606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:33.509968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] PATH_INFO: `/v3/users/17b8943f6f9946f1b150046b9455ca50` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:33.511681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b8943f6f9946f1b150046b9455ca50)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:33.514101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:33.539794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d409d7a-2a79-4e67-9d01-c2a96372e82c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:33.543798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ba2e8-645e-40d7-876a-7d957dfb0d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:33.544448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ba2e8-645e-40d7-876a-7d957dfb0d7e service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:33.546315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ba2e8-645e-40d7-876a-7d957dfb0d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:33.546598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ba2e8-645e-40d7-876a-7d957dfb0d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:33.571203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ba2e8-645e-40d7-876a-7d957dfb0d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:33.572671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ba2e8-645e-40d7-876a-7d957dfb0d7e service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:33.581615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b8943f6f9946f1b150046b9455ca50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:33.582816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b8943f6f9946f1b150046b9455ca50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:33.592503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b8943f6f9946f1b150046b9455ca50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:33.598862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1015/2034] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:33.606115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b8943f6f9946f1b150046b9455ca50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:33.606925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b8943f6f9946f1b150046b9455ca50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:33.634589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1020/2035] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:33 2022] DELETE /identity/v3/users/17b8943f6f9946f1b150046b9455ca50 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:33.640096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:33.640392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:33.640669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:33.662853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:33.664109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:33.753333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1016/2036] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:33.834248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:33.835807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:33.970156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185e15c-5368-4655-a724-65f78ea2e979 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:33.974755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe444f9-fa00-481a-bf1c-10b3abf93f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:33.975389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe444f9-fa00-481a-bf1c-10b3abf93f70 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:33.975720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe444f9-fa00-481a-bf1c-10b3abf93f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:33.976118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe444f9-fa00-481a-bf1c-10b3abf93f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:33.990331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe444f9-fa00-481a-bf1c-10b3abf93f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:33.991796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe444f9-fa00-481a-bf1c-10b3abf93f70 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:34.002104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:34.004432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:34.005847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1021/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:34.018810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb58fb-5a46-453d-80c2-68d3c5cd6b97 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:34.024160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503761-682c-4216-9366-57b277a3228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:34.024486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503761-682c-4216-9366-57b277a3228d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:34.024752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503761-682c-4216-9366-57b277a3228d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:34.025121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85503761-682c-4216-9366-57b277a3228d admin admin] PATH_INFO: `/v3/users/fd1527ed331941f3961495b65de032f4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:34.026390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85503761-682c-4216-9366-57b277a3228d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1527ed331941f3961495b65de032f4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:34.028759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85503761-682c-4216-9366-57b277a3228d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:34.098599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1527ed331941f3961495b65de032f4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:34.099358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1527ed331941f3961495b65de032f4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:34.110514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1527ed331941f3961495b65de032f4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:34.111459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1527ed331941f3961495b65de032f4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:34.131553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1527ed331941f3961495b65de032f4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:34.151760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1017/2038] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:34 2022] DELETE /identity/v3/users/fd1527ed331941f3961495b65de032f4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:34.157657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:34.158573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:34.159601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:34.188277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:34.190067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:34.212629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:34.286515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1022/2039] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:34.312901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:34.314547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:34.441471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85503761-682c-4216-9366-57b277a3228d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:34.446046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:34.447081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:34.447517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:34.447838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:34.479576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:34.489439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:34.491779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:34.537028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1018/2040] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:35.013174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:35.014701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:35.031307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa093b4-928d-4352-9761-ac16adf6cb1b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:35.059824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:35.060748 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:35.061261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:35.061543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] PATH_INFO: `/v3/projects/8d91ce5093e74d4797ef405c05afff85` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:35.062807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d91ce5093e74d4797ef405c05afff85)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:35.064786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:35.106958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:35.109493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:35.130338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d91ce5093e74d4797ef405c05afff85', 'request_id': 'req-5601422a-e465-4d2b-a48a-8dceec6023a9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.139001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a3ac-23bd-4749-9964-24c5f831506c service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:35.140810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d91ce5093e74d4797ef405c05afff85', 'request_id': 'req-5601422a-e465-4d2b-a48a-8dceec6023a9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.157104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d91ce5093e74d4797ef405c05afff85', 'request_id': 'req-5601422a-e465-4d2b-a48a-8dceec6023a9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.174178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] The token cache is being invalidate because project 8d91ce5093e74d4797ef405c05afff85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:35.174819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.175438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.180261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1023/2041] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:35 2022] DELETE /identity/v3/projects/8d91ce5093e74d4797ef405c05afff85 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:35.181455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:35.183107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:35.219540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:35.220585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:35.220867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:35.221172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] PATH_INFO: `/v3/projects/558a927f21c14d678684c61809bf957e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:35.222309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=558a927f21c14d678684c61809bf957e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:35.224236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:35.268342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601422a-e465-4d2b-a48a-8dceec6023a9 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:35.280621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:35.281330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:35.281615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:35.281892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] PATH_INFO: `/v3/users/56495345084343db8e840c4b2af354f0` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:35.287076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56495345084343db8e840c4b2af354f0)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:35.289308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:35.312954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558a927f21c14d678684c61809bf957e', 'request_id': 'req-386c41b0-51e7-4e3d-8fdb-f76469adb64d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.323376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558a927f21c14d678684c61809bf957e', 'request_id': 'req-386c41b0-51e7-4e3d-8fdb-f76469adb64d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.332291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558a927f21c14d678684c61809bf957e', 'request_id': 'req-386c41b0-51e7-4e3d-8fdb-f76469adb64d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.346151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] The token cache is being invalidate because project 558a927f21c14d678684c61809bf957e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:35.346469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.347101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.349745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56495345084343db8e840c4b2af354f0'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.350211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1019/2042] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:35 2022] DELETE /identity/v3/projects/558a927f21c14d678684c61809bf957e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:35.350875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56495345084343db8e840c4b2af354f0'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.351092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:35.352545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:35.355135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:35.365077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56495345084343db8e840c4b2af354f0'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.377431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56495345084343db8e840c4b2af354f0'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.379286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56495345084343db8e840c4b2af354f0'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.412779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1024/2043] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:35 2022] DELETE /identity/v3/users/56495345084343db8e840c4b2af354f0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:35.418085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:35.419957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:35.465599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c41b0-51e7-4e3d-8fdb-f76469adb64d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:35.552490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:35.615952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:35.619133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:35.619507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:35.620313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] PATH_INFO: `/v3/projects/4ced036b89d54bca9c6b3344daab3dc6` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:35.621295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5aae-0ed1-4c9b-8977-4736fc3837b0 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:35.624426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ced036b89d54bca9c6b3344daab3dc6)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:35.627454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:35.628112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:35.628389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:35.628737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] PATH_INFO: `/v3/users/198ba8f48dbf4aa3a9e82e453eaa779a` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:35.629969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=198ba8f48dbf4aa3a9e82e453eaa779a)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:35.632023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:35.633572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:35.712673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198ba8f48dbf4aa3a9e82e453eaa779a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.714115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198ba8f48dbf4aa3a9e82e453eaa779a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.739396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ced036b89d54bca9c6b3344daab3dc6', 'request_id': 'req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.742014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198ba8f48dbf4aa3a9e82e453eaa779a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.753953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ced036b89d54bca9c6b3344daab3dc6', 'request_id': 'req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.757593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198ba8f48dbf4aa3a9e82e453eaa779a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.758334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198ba8f48dbf4aa3a9e82e453eaa779a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.768959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ced036b89d54bca9c6b3344daab3dc6', 'request_id': 'req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.783578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] The token cache is being invalidate because project 4ced036b89d54bca9c6b3344daab3dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:35.783884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.784420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1025/2044] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:35 2022] DELETE /identity/v3/users/198ba8f48dbf4aa3a9e82e453eaa779a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:35.784541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:35.786768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1020/2045] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:35 2022] DELETE /identity/v3/projects/4ced036b89d54bca9c6b3344daab3dc6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:35.792100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:35.793579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:35.870954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:35.897814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30331b2b-5ea4-4dc4-a672-606934fc7295 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:35.903481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:35.904637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:35.904637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:35.906751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] PATH_INFO: `/v3/users/7fb17d426d0040db8c572b04050ed0c2` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:35.913948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb17d426d0040db8c572b04050ed0c2)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:35.921922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:35.968624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:35.970215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:36.014673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb17d426d0040db8c572b04050ed0c2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.015376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb17d426d0040db8c572b04050ed0c2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.028933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb17d426d0040db8c572b04050ed0c2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.041075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb17d426d0040db8c572b04050ed0c2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.042724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-11bde7dd-cced-41c6-b929-d7bd0aa42638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb17d426d0040db8c572b04050ed0c2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.072278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1026/2046] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:35 2022] DELETE /identity/v3/users/7fb17d426d0040db8c572b04050ed0c2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:36.088861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4fce6-cce2-48e9-879d-69f03b6ae2a8 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.153020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.153753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.154477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.154829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] PATH_INFO: `/v3/projects/4f75ce10662c4faeb90669a34f52a3c3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.157292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f75ce10662c4faeb90669a34f52a3c3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.160967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.171062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:36.211402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f75ce10662c4faeb90669a34f52a3c3', 'request_id': 'req-68a779dc-586c-4b25-be90-d34bbec62f49'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.219733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f75ce10662c4faeb90669a34f52a3c3', 'request_id': 'req-68a779dc-586c-4b25-be90-d34bbec62f49'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.225740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f75ce10662c4faeb90669a34f52a3c3', 'request_id': 'req-68a779dc-586c-4b25-be90-d34bbec62f49'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.237247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] The token cache is being invalidate because project 4f75ce10662c4faeb90669a34f52a3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:36.237540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.238262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-68a779dc-586c-4b25-be90-d34bbec62f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.240019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1021/2047] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:35 2022] DELETE /identity/v3/projects/4f75ce10662c4faeb90669a34f52a3c3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:36.246275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3ac1-d4c2-49dd-80a1-1c32bbd80365 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.246770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3ac1-d4c2-49dd-80a1-1c32bbd80365 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.246869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3ac1-d4c2-49dd-80a1-1c32bbd80365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.267119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-904b3ac1-d4c2-49dd-80a1-1c32bbd80365 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:36.268636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-904b3ac1-d4c2-49dd-80a1-1c32bbd80365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:36.333611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1027/2048] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:36.342696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ade9-0105-4e7e-b038-0ba063c4ede6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.343081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ade9-0105-4e7e-b038-0ba063c4ede6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.343407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44ade9-0105-4e7e-b038-0ba063c4ede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.364517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8f44ade9-0105-4e7e-b038-0ba063c4ede6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:36.365863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8f44ade9-0105-4e7e-b038-0ba063c4ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:36.374772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1022/2049] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:36.379647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3ac1-d4c2-49dd-80a1-1c32bbd80365 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:36.390439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3ac1-d4c2-49dd-80a1-1c32bbd80365 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.396259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.397009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.397360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.397715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.398593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:36.399125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.401154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.415300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1028/2050] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:36.420034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44ade9-0105-4e7e-b038-0ba063c4ede6 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:36.430112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44ade9-0105-4e7e-b038-0ba063c4ede6 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.435292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.436145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.436531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.436935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.437727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.439755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.470627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1023/2051] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:36 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:36.474948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:36.487006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699a2ba-0b82-4489-8300-a061fd620342 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.510882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:36.512703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:36.586625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:36.604602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.605516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.605968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.606394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.607213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.609454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.646717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1029/2052] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:36 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:36.648180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:36.651494 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:36.671514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca18869-442d-420f-8fff-8139c09f2fb3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.675010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a80466-0dfe-4cd9-9f90-1db4662dbcdb admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.678632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.679536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.680121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.680453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] PATH_INFO: `/v3/projects/65a262515e574a6b86f64194fe1e07f3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.681650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.682043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a262515e574a6b86f64194fe1e07f3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.682472 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.682634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.682911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] PATH_INFO: `/v3/projects/ed6cbbe4ecc54611895fc7fe4c364c27` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.684367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6cbbe4ecc54611895fc7fe4c364c27)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.694076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.694915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.761581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6cbbe4ecc54611895fc7fe4c364c27', 'request_id': 'req-f0e89725-b09b-4ede-86e6-6c81e31a19e8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.764587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6cbbe4ecc54611895fc7fe4c364c27', 'request_id': 'req-f0e89725-b09b-4ede-86e6-6c81e31a19e8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.769991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6cbbe4ecc54611895fc7fe4c364c27', 'request_id': 'req-f0e89725-b09b-4ede-86e6-6c81e31a19e8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.788647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a262515e574a6b86f64194fe1e07f3', 'request_id': 'req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.792644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] The token cache is being invalidate because project ed6cbbe4ecc54611895fc7fe4c364c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:36.792852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.793852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.796112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1030/2053] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:36 2022] DELETE /identity/v3/projects/ed6cbbe4ecc54611895fc7fe4c364c27 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:36.797050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:36.798505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:36.800479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a262515e574a6b86f64194fe1e07f3', 'request_id': 'req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.807569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a262515e574a6b86f64194fe1e07f3', 'request_id': 'req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.816613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:36.820581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] The token cache is being invalidate because project 65a262515e574a6b86f64194fe1e07f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:36.821254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.822925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.825207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1024/2054] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:36 2022] DELETE /identity/v3/projects/65a262515e574a6b86f64194fe1e07f3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:36.837234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:36.837234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:36.884081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89725-b09b-4ede-86e6-6c81e31a19e8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.915498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516312b-94b1-482a-b6ed-fbf8a57fa4a4 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:36.921835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.922506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.922821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.923120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] PATH_INFO: `/v3/users/9179ae41474a4f49983ddacc62b15cf7` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.924390 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9179ae41474a4f49983ddacc62b15cf7)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.926375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.962316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bd80c-0dd6-4aab-9b1e-6002669abf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:36.963015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd80c-0dd6-4aab-9b1e-6002669abf55 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.963358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd80c-0dd6-4aab-9b1e-6002669abf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.963642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd80c-0dd6-4aab-9b1e-6002669abf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.964523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bd80c-0dd6-4aab-9b1e-6002669abf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:36.966204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bd80c-0dd6-4aab-9b1e-6002669abf55 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:36.984085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1031/2055] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:36.984085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:36.984085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:36.984085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:36.992944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9179ae41474a4f49983ddacc62b15cf7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:36.993658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9179ae41474a4f49983ddacc62b15cf7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.000470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:37.003600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9179ae41474a4f49983ddacc62b15cf7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.005030 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9179ae41474a4f49983ddacc62b15cf7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.009262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:37.011385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.022688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6b44fe16-4072-46a7-8e8b-acd0968550ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9179ae41474a4f49983ddacc62b15cf7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.026177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1032/2056] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:37.027352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.029289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.037518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1025/2057] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:36 2022] DELETE /identity/v3/users/9179ae41474a4f49983ddacc62b15cf7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:37.038814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1eab7-c1c6-4685-90fa-841d69ce3294 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.039102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1eab7-c1c6-4685-90fa-841d69ce3294 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.039376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1eab7-c1c6-4685-90fa-841d69ce3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.058656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515772f1-860d-4689-8eed-4cd196e05b08 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.063431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e2b1eab7-c1c6-4685-90fa-841d69ce3294 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:37.065103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e2b1eab7-c1c6-4685-90fa-841d69ce3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.145177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.146916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.147280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.147570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.148349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.149983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.158609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1026/2058] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:37.164694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1eab7-c1c6-4685-90fa-841d69ce3294 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.176387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1033/2059] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:37.176954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1eab7-c1c6-4685-90fa-841d69ce3294 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.177930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.182844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.183496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.183782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.184776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.185594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:37.185857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.187979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.191715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c871-2224-4f34-9320-d1ecfd003f9f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.200545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec6c7f-9e33-46b9-ab1c-e2915a45ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.201897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6c7f-9e33-46b9-ab1c-e2915a45ebd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.202451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6c7f-9e33-46b9-ab1c-e2915a45ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.203132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec6c7f-9e33-46b9-ab1c-e2915a45ebd6 admin admin] PATH_INFO: `/v3/projects/a70d1151e7a0443c8e7fb5e1aad87236/users/e4c18ef52641471d9a3f148b165e9af8/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.207256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1027/2060] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:50:37.212221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.224643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62330c7-68b2-4a3e-8cd7-36fd9ba61bb2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.226371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec6c7f-9e33-46b9-ab1c-e2915a45ebd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70d1151e7a0443c8e7fb5e1aad87236, user_id=e4c18ef52641471d9a3f148b165e9af8, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.230096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec6c7f-9e33-46b9-ab1c-e2915a45ebd6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.230328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.231094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.231393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.231658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.232330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.234344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.239908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:37.253748 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1034/2061] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:37 2022] PUT /identity/v3/projects/a70d1151e7a0443c8e7fb5e1aad87236/users/e4c18ef52641471d9a3f148b165e9af8/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:37.266124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.266418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.266690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.280893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1028/2062] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:37.286676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.303072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] MFA Rules not processed for user `e4c18ef52641471d9a3f148b165e9af8`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:37.304611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.371344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d773deb-352d-4b7f-b2aa-2c9b23fb9bf9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.379226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.380094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.380402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.380800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.381471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.383483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.396543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1035/2063] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:37.410589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.413874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1029/2064] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:37.417104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.419614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.430722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b63606-9413-4522-b7e8-9759dc615862 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.439408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.440308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.440743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.441043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.441624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.443436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.462615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1030/2065] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:37.463495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.465767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.479273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf16e-2386-41b5-b311-02bb8e1d9beb admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.484266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.484948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.485255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.485636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] PATH_INFO: `/v3/projects/e4c993af510d4050be93134f460e113d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.486755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c993af510d4050be93134f460e113d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.488679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.495555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b68c00-bdc0-4f26-9fcd-fd8664a1cfff None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.499650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.500260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.500544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.500814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.509464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.510896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.520978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1036/2066] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:37.521898 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.528173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:37.533438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549f1fe-75c8-45fb-86a1-6d708501523a service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.540828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c993af510d4050be93134f460e113d', 'request_id': 'req-61f67eb9-f230-4993-8196-5ef01e39228b'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.553111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c993af510d4050be93134f460e113d', 'request_id': 'req-61f67eb9-f230-4993-8196-5ef01e39228b'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.559218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c993af510d4050be93134f460e113d', 'request_id': 'req-61f67eb9-f230-4993-8196-5ef01e39228b'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.571501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] The token cache is being invalidate because project e4c993af510d4050be93134f460e113d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:37.571793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.572483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.574018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1031/2067] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:37 2022] DELETE /identity/v3/projects/e4c993af510d4050be93134f460e113d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:37.579440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.579440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.596247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c72bee-7647-47c4-88e0-5be185e3d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.596857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c72bee-7647-47c4-88e0-5be185e3d0ac admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.597178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c72bee-7647-47c4-88e0-5be185e3d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.597452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c72bee-7647-47c4-88e0-5be185e3d0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.598098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c72bee-7647-47c4-88e0-5be185e3d0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.599776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c72bee-7647-47c4-88e0-5be185e3d0ac admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.610539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1037/2068] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:37.611793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.612066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.612350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.629228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:37.633544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:37.635081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.643726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1038/2069] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:37.645790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.647095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.647535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f67eb9-f230-4993-8196-5ef01e39228b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.652176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.652812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.653123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.653397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] PATH_INFO: `/v3/users/e4c18ef52641471d9a3f148b165e9af8` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.654832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c18ef52641471d9a3f148b165e9af8)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.657013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.660336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7132-bec6-417d-83a0-f3911bd5a9d9 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.665465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292dd9d-3241-434c-9c18-d18c3636c269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.666153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292dd9d-3241-434c-9c18-d18c3636c269 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.666432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292dd9d-3241-434c-9c18-d18c3636c269 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.666707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292dd9d-3241-434c-9c18-d18c3636c269 admin admin] PATH_INFO: `/v3/projects/77eb34c16e7646449256ec54780dec36/users/54fb075bba394209b240649e2c1fbed3/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.681873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292dd9d-3241-434c-9c18-d18c3636c269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77eb34c16e7646449256ec54780dec36, user_id=54fb075bba394209b240649e2c1fbed3, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.684990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292dd9d-3241-434c-9c18-d18c3636c269 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.705779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1039/2070] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:37 2022] PUT /identity/v3/projects/77eb34c16e7646449256ec54780dec36/users/54fb075bba394209b240649e2c1fbed3/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:37.707059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac4af7-00aa-404a-bc4f-6c0ef19651b0 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.707353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac4af7-00aa-404a-bc4f-6c0ef19651b0 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.707629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac4af7-00aa-404a-bc4f-6c0ef19651b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.724282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c18ef52641471d9a3f148b165e9af8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.724977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c18ef52641471d9a3f148b165e9af8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.729043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-21ac4af7-00aa-404a-bc4f-6c0ef19651b0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:37.730300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-21ac4af7-00aa-404a-bc4f-6c0ef19651b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.733897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c18ef52641471d9a3f148b165e9af8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.734541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c18ef52641471d9a3f148b165e9af8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.748309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9c750a5c-0934-445a-9f39-f21a7eff6fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c18ef52641471d9a3f148b165e9af8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:37.760671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1032/2071] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:37 2022] DELETE /identity/v3/users/e4c18ef52641471d9a3f148b165e9af8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:37.762318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.762318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.762549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.797286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1040/2072] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:37.798921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4053ef-b537-4239-bc63-d97af83d3cae None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.799030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4053ef-b537-4239-bc63-d97af83d3cae None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.799232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4053ef-b537-4239-bc63-d97af83d3cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.809062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] MFA Rules not processed for user `54fb075bba394209b240649e2c1fbed3`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:37.810331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.819096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3c4053ef-b537-4239-bc63-d97af83d3cae None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:37.820297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3c4053ef-b537-4239-bc63-d97af83d3cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.904229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1041/2073] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:37.907087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1033/2074] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:37.908396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4053ef-b537-4239-bc63-d97af83d3cae None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.914744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.916654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.919404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4053ef-b537-4239-bc63-d97af83d3cae None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.924482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.925292 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.925561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.925849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.926505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:37.926812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.928419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.934395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21e3f-13b2-4e38-ad74-5a35b79e83b3 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:37.935451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:37.946830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:37.947460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:37.947742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:37.948015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:37.952370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1042/2075] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:37.952522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:37.952618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:37.952704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:37.952804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:37.981173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1034/2076] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:37.982093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.014277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecfd50-12f0-4686-bf63-dc86d99bc977 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.020169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:38.051754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a8468-9cf0-4033-9b58-85a6fd6da5cb admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.056891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.057535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.057820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.058094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.058730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.060818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.065373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.065983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.066261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.066530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.075649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.077524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.087908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1043/2077] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:38.088745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.092464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1035/2078] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:37 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:38.093341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.099411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d98f-1897-44cc-a5dc-49435069b46e service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.162013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad80322-60d0-4057-a7a5-bfe2a1fee740 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.176144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.177790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.178375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.178803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.183124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.183732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.184459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.184808 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.185213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.185746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.186124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.188306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.211195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1036/2079] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:38 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:38.215627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.227796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1044/2080] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:38 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:38.229175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.238089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0d71-b05d-48f1-82d2-f4bc45eaeb39 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.240590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223a7a8-0c86-436c-8ee1-81393b9a15a4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.244013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.244872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.245347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.245779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.246662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.248307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.249640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.249863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.250340 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.250792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.251883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.253874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.269298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1045/2081] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:38.272540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.274024 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1037/2082] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:38.278168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.286947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4da84-6eec-4f6e-b1d2-e37a360168e8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.295460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660b823-75ab-4042-b620-89f2eedb00d9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.300603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.301390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.301690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.302145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] PATH_INFO: `/v3/projects/22a761e297504dbdb14f73744fb3ebb3/users/1327bd76aca04804b9154231eb1c0dd1/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.306240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.308109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.308777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.309552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.310635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.313184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.320055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a761e297504dbdb14f73744fb3ebb3, user_id=1327bd76aca04804b9154231eb1c0dd1, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.323040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.327850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1038/2083] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:38.333480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.340136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1046/2084] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:38 2022] PUT /identity/v3/projects/22a761e297504dbdb14f73744fb3ebb3/users/1327bd76aca04804b9154231eb1c0dd1/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:38.344638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.346173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2842cdc-4bd9-4a02-b6f3-187385601f2e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.358516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:38.421590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86319bc2-6911-434e-a917-0b9253aa8d82 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.426701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.427464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.427719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.428011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.428654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.430755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.433944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.434881 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.435466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.436525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] PATH_INFO: `/v3/projects/95ec484bb2a24c4cb4d6cd261a39d4fc/users/2ea884a96ca74edc98e58bba20fcd966/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.454948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1047/2085] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:38.459296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ec484bb2a24c4cb4d6cd261a39d4fc, user_id=2ea884a96ca74edc98e58bba20fcd966, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.462619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.464521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.483220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2d23-234c-4b51-98ea-1b5294c4acd2 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.489278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1039/2086] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:38 2022] PUT /identity/v3/projects/95ec484bb2a24c4cb4d6cd261a39d4fc/users/2ea884a96ca74edc98e58bba20fcd966/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:38.494305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.500199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:38.527613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:38.578036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ac9b9-9446-4931-b2f9-32357a799308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.578754 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ac9b9-9446-4931-b2f9-32357a799308 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.579040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ac9b9-9446-4931-b2f9-32357a799308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.579315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ac9b9-9446-4931-b2f9-32357a799308 admin admin] PATH_INFO: `/v3/projects/22a761e297504dbdb14f73744fb3ebb3/users/1327bd76aca04804b9154231eb1c0dd1/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.581421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ac9b9-9446-4931-b2f9-32357a799308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a761e297504dbdb14f73744fb3ebb3, user_id=1327bd76aca04804b9154231eb1c0dd1, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.584357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ac9b9-9446-4931-b2f9-32357a799308 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.606207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1048/2087] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:38 2022] PUT /identity/v3/projects/22a761e297504dbdb14f73744fb3ebb3/users/1327bd76aca04804b9154231eb1c0dd1/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:38.606207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9457c-8ef2-4291-8c18-8a8332394f25 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.606207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9457c-8ef2-4291-8c18-8a8332394f25 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.606207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9457c-8ef2-4291-8c18-8a8332394f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.611260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b511-f3f6-4cd8-a679-d25f9dfb7fba admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.639275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ebb9457c-8ef2-4291-8c18-8a8332394f25 None None] MFA Rules not processed for user `2ea884a96ca74edc98e58bba20fcd966`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:38.640573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ebb9457c-8ef2-4291-8c18-8a8332394f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:38.698359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.698533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.698926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.699304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] PATH_INFO: `/v3/projects/a70d1151e7a0443c8e7fb5e1aad87236` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.701454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70d1151e7a0443c8e7fb5e1aad87236)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.704712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.722256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1049/2088] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:38.723465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed0147-a20a-4989-a4fe-4415ad424983 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.723761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed0147-a20a-4989-a4fe-4415ad424983 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.724036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed0147-a20a-4989-a4fe-4415ad424983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.756858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c5ed0147-a20a-4989-a4fe-4415ad424983 None None] MFA Rules not processed for user `1327bd76aca04804b9154231eb1c0dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:38.758400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c5ed0147-a20a-4989-a4fe-4415ad424983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:38.762553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70d1151e7a0443c8e7fb5e1aad87236', 'request_id': 'req-1e11d790-76d4-40a8-a63f-2661db34c6fc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:38.771634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70d1151e7a0443c8e7fb5e1aad87236', 'request_id': 'req-1e11d790-76d4-40a8-a63f-2661db34c6fc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:38.782430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70d1151e7a0443c8e7fb5e1aad87236', 'request_id': 'req-1e11d790-76d4-40a8-a63f-2661db34c6fc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:38.786146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:38.798113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] The token cache is being invalidate because project a70d1151e7a0443c8e7fb5e1aad87236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:38.798540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:38.799220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:38.805410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1040/2089] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:38 2022] DELETE /identity/v3/projects/a70d1151e7a0443c8e7fb5e1aad87236 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:38.806391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.808106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:38.847962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1050/2090] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:38.849606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0e9e-c64f-4ec5-8525-1179d1073792 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.850061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0e9e-c64f-4ec5-8525-1179d1073792 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.850664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0e9e-c64f-4ec5-8525-1179d1073792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.869039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:38.870895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-79dd0e9e-c64f-4ec5-8525-1179d1073792 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:38.872614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-79dd0e9e-c64f-4ec5-8525-1179d1073792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:38.892392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11d790-76d4-40a8-a63f-2661db34c6fc admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:38.897280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:38.897892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:38.898173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:38.899805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:38.900455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:38.902480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:38.938675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1041/2091] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:38 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:38.939661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.941232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:38.947740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1051/2092] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:38.948633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0e9e-c64f-4ec5-8525-1179d1073792 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:38.969113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0e9e-c64f-4ec5-8525-1179d1073792 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.029598 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa334df4-c6da-402e-8045-ec5fec447de4 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.033860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.034553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.035011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.035341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.055630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af0a21-3c43-497b-92b5-e5de9adb1412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.056334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0a21-3c43-497b-92b5-e5de9adb1412 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.056679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0a21-3c43-497b-92b5-e5de9adb1412 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.057046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af0a21-3c43-497b-92b5-e5de9adb1412 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.057818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af0a21-3c43-497b-92b5-e5de9adb1412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.059869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af0a21-3c43-497b-92b5-e5de9adb1412 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.086105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1052/2093] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:38 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:39.087564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0c390-d333-4d34-a83a-24d45fef686f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.088012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0c390-d333-4d34-a83a-24d45fef686f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.088298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0c390-d333-4d34-a83a-24d45fef686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.106393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.108150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.109304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-78c0c390-d333-4d34-a83a-24d45fef686f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:39.110514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-78c0c390-d333-4d34-a83a-24d45fef686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:39.119430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1053/2094] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:39.120219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1042/2095] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:39.120327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0c390-d333-4d34-a83a-24d45fef686f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.123789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.140779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d51eb7-974f-4d42-80cf-2f724c59e3e7 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.143306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0c390-d333-4d34-a83a-24d45fef686f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.145931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.146579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.146862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.147149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.147780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:39.148084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.149828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.154972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.155588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.155867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.156137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.156782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.162904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.165514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1043/2096] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:50:39.167980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.178396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1054/2097] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:39.182751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa493d7-8244-4182-beec-b8a4b3c4ba03 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.183873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.189817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.190535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.190906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.191266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.191991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.194456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.202495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a627a2-c573-4199-8dab-16dbb85c4926 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.209479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.210936 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.211370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.211892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] PATH_INFO: `/v3/projects/83d1e27907954cf08887a7a3f8454550/users/398a4b22abb049cb92aded964df2f3ef/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.242819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1044/2098] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:39 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:39.246991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.251332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d1e27907954cf08887a7a3f8454550, user_id=398a4b22abb049cb92aded964df2f3ef, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.254367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.273883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1055/2099] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:39 2022] PUT /identity/v3/projects/83d1e27907954cf08887a7a3f8454550/users/398a4b22abb049cb92aded964df2f3ef/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:39.277655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.284719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:39.325081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:39.350049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfe246-a214-4750-a462-485e071b1a0b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.369176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf24a1-1024-461f-a6c0-8d20577020c5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.384103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.384830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.385232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.385957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.386621 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.389239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.405103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1056/2100] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:39.409747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.425561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316493b4-a114-4026-9c7f-e8365b6237bb admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.432812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf626be-30f4-4ef8-b643-50d4931ca53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.433008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.433500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.433723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf626be-30f4-4ef8-b643-50d4931ca53f admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.433831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.433999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf626be-30f4-4ef8-b643-50d4931ca53f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.434110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.434260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf626be-30f4-4ef8-b643-50d4931ca53f admin admin] PATH_INFO: `/v3/projects/83d1e27907954cf08887a7a3f8454550/users/398a4b22abb049cb92aded964df2f3ef/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.434702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.436714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.436991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf626be-30f4-4ef8-b643-50d4931ca53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d1e27907954cf08887a7a3f8454550, user_id=398a4b22abb049cb92aded964df2f3ef, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.442101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf626be-30f4-4ef8-b643-50d4931ca53f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.455515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1057/2101] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:39 2022] PUT /identity/v3/projects/83d1e27907954cf08887a7a3f8454550/users/398a4b22abb049cb92aded964df2f3ef/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:39.467629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1045/2102] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:39 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:39.467841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2cc2-428b-49bd-88af-44e21ea3568a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.467989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2cc2-428b-49bd-88af-44e21ea3568a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.468259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2cc2-428b-49bd-88af-44e21ea3568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.468704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.480799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97411f4-d20d-4f4e-bdba-a3a8e4af9e35 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.511214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0a0f2cc2-428b-49bd-88af-44e21ea3568a None None] MFA Rules not processed for user `398a4b22abb049cb92aded964df2f3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:39.512671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0a0f2cc2-428b-49bd-88af-44e21ea3568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:39.568359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.569097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.569439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.569780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.570518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.572986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.587649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1046/2103] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:39.587649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.608749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1058/2104] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:39.614169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f2cc2-428b-49bd-88af-44e21ea3568a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.634053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f2cc2-428b-49bd-88af-44e21ea3568a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.638988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.639679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.640607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.641102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.641831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.643524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.658531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1059/2105] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:39.659544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.663771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:39.674702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d03c2-02cd-4294-8ae5-212dd052c4ef admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.680212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1327bd76aca04804b9154231eb1c0dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a761e297504dbdb14f73744fb3ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.680833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.681149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.681601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.682082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:39.682388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.684384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.707483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1047/2106] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:39.707483 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.723023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2a232-47cf-45c5-ac2b-880e7d38d211 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.729079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.730420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.730780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.731126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] PATH_INFO: `/v3/projects/5fbbabad77814d68bb193c8c8706d40f/users/d7f2702c7132402d863c77e0d896e738/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.744010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:39.750939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae55cb6-2298-4aae-a667-b7f2c4bdc5de admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.752033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbbabad77814d68bb193c8c8706d40f, user_id=d7f2702c7132402d863c77e0d896e738, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.755113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.755502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f982e3-8ade-4558-8990-0f4f080c6e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.756834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f982e3-8ade-4558-8990-0f4f080c6e1b service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.757229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f982e3-8ade-4558-8990-0f4f080c6e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.757584 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f982e3-8ade-4558-8990-0f4f080c6e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.770455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f982e3-8ade-4558-8990-0f4f080c6e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.771981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f982e3-8ade-4558-8990-0f4f080c6e1b service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.776243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1048/2107] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:39 2022] PUT /identity/v3/projects/5fbbabad77814d68bb193c8c8706d40f/users/d7f2702c7132402d863c77e0d896e738/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:39.777876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.790991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1060/2108] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:39.804485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413bdf9-4d70-495f-9146-fe4e70682274 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.804827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413bdf9-4d70-495f-9146-fe4e70682274 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.805097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413bdf9-4d70-495f-9146-fe4e70682274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.825083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:39.869421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5413bdf9-4d70-495f-9146-fe4e70682274 None None] MFA Rules not processed for user `d7f2702c7132402d863c77e0d896e738`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:39.870884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5413bdf9-4d70-495f-9146-fe4e70682274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:39.894985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ceac9-d230-4735-9040-079c0f177eaa admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:39.901071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1327bd76aca04804b9154231eb1c0dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a761e297504dbdb14f73744fb3ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:39.901960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:39.902365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:39.902738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:39.903544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:39.907805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:39.946451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1049/2109] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:39 2022] POST /identity/v3/projects => generated 354 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:39.950223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:39.996482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1061/2110] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:40.002186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413bdf9-4d70-495f-9146-fe4e70682274 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:40.015279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413bdf9-4d70-495f-9146-fe4e70682274 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:40.016899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519861-6e02-4afe-83f8-a6ce5901cc72 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:40.022026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:40.022750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.023097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.023433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.026175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:40.085204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1327bd76aca04804b9154231eb1c0dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a761e297504dbdb14f73744fb3ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:40.085915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.086405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.086753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.087595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:40.088262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:40.089703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:40.096368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:40.098000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:40.109275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1062/2111] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:40.109275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:40.117887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37707f-9d04-45c2-89a0-c245018a121d tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:40.119773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1050/2112] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:40.121831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:40.122469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.124390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.124672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.183605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:40.198289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f75a3-8ec5-4a94-83e2-77a0178357c0 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:40.204200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1327bd76aca04804b9154231eb1c0dd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a761e297504dbdb14f73744fb3ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:40.204848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.205164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.205442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] PATH_INFO: `/v3/projects/5ff9e5dc1b7a4a65aa694e231a315cb0` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.207038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ff9e5dc1b7a4a65aa694e231a315cb0)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:40.210062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:40.217081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:40.219365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:40.235972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1063/2113] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:40.249632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:40.276455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:40.292159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff9e5dc1b7a4a65aa694e231a315cb0', 'request_id': 'req-f48822e0-6d4e-4642-ba42-f10c77fbc626'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.319402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:40.321796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff9e5dc1b7a4a65aa694e231a315cb0', 'request_id': 'req-f48822e0-6d4e-4642-ba42-f10c77fbc626'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.334217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff9e5dc1b7a4a65aa694e231a315cb0', 'request_id': 'req-f48822e0-6d4e-4642-ba42-f10c77fbc626'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.353923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] The token cache is being invalidate because project 5ff9e5dc1b7a4a65aa694e231a315cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:40.354229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.356684 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.361348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1051/2114] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:40 2022] DELETE /identity/v3/projects/5ff9e5dc1b7a4a65aa694e231a315cb0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:40.401065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd90b58-3613-4352-9524-054087e18a4b service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:40.559044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:40.560844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.562036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.562402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] PATH_INFO: `/v3/users/d7f2702c7132402d863c77e0d896e738` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.563823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f2702c7132402d863c77e0d896e738)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:40.566183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:40.614217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:40.616094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:40.636954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48822e0-6d4e-4642-ba42-f10c77fbc626 tempest-VolumeQuotaClassesTest-1675769119 tempest-VolumeQuotaClassesTest-1675769119-project-admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:40.643400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:40.644101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.644384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.645722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] PATH_INFO: `/v3/users/2ea884a96ca74edc98e58bba20fcd966` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.646968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea884a96ca74edc98e58bba20fcd966)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:40.650072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:40.668004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f2702c7132402d863c77e0d896e738'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.669350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f2702c7132402d863c77e0d896e738'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.689493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f2702c7132402d863c77e0d896e738'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.719201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f2702c7132402d863c77e0d896e738'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.720309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f2702c7132402d863c77e0d896e738'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.725548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea884a96ca74edc98e58bba20fcd966'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.726235 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea884a96ca74edc98e58bba20fcd966'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.746747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea884a96ca74edc98e58bba20fcd966'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.747558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea884a96ca74edc98e58bba20fcd966'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.753174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1064/2115] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:40 2022] DELETE /identity/v3/users/d7f2702c7132402d863c77e0d896e738 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:40.754433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:40.756181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:40.767157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-64ae42f8-49b3-4e15-990e-b41f9806e489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea884a96ca74edc98e58bba20fcd966'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:40.788815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1052/2116] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:40 2022] DELETE /identity/v3/users/2ea884a96ca74edc98e58bba20fcd966 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:40.791248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bcb73-d3e8-4520-a5d8-bf4008cb21f9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.792094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bcb73-d3e8-4520-a5d8-bf4008cb21f9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.792514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bcb73-d3e8-4520-a5d8-bf4008cb21f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.816769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-db8bcb73-d3e8-4520-a5d8-bf4008cb21f9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:40.818685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-db8bcb73-d3e8-4520-a5d8-bf4008cb21f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:40.827131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:40.846928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095dbb4-0342-431a-a1ed-042a0ce27d26 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:40.918626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1053/2117] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:40.918626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.918626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.918626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.935684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:40.936790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:40.937111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:40.937394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] PATH_INFO: `/v3/users/54fb075bba394209b240649e2c1fbed3` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:40.939247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fb075bba394209b240649e2c1fbed3)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:40.940786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:40.941860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:40.942066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:40.962125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1054/2118] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:40.962125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:40.963244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:40.988008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:41.039858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fb075bba394209b240649e2c1fbed3'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.040589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fb075bba394209b240649e2c1fbed3'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.051565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fb075bba394209b240649e2c1fbed3'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.066183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fb075bba394209b240649e2c1fbed3'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.068786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fb075bba394209b240649e2c1fbed3'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.073084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5368243-da0a-4edc-a327-c08802784fc4 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:41.077266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693cb9a-3f84-4988-b864-ccd1c7a39121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:41.077991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693cb9a-3f84-4988-b864-ccd1c7a39121 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:41.078271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693cb9a-3f84-4988-b864-ccd1c7a39121 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:41.078659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693cb9a-3f84-4988-b864-ccd1c7a39121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:41.082646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d693cb9a-3f84-4988-b864-ccd1c7a39121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:41.098345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693cb9a-3f84-4988-b864-ccd1c7a39121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:41.098518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1065/2119] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:40 2022] DELETE /identity/v3/users/54fb075bba394209b240649e2c1fbed3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:41.099983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693cb9a-3f84-4988-b864-ccd1c7a39121 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:41.103225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:41.104922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:41.111867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1055/2120] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:41.113281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb193-8edc-4696-bd81-3163bb6ea36e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:41.113606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb193-8edc-4696-bd81-3163bb6ea36e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:41.113875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bb193-8edc-4696-bd81-3163bb6ea36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:41.158093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-940bb193-8edc-4696-bd81-3163bb6ea36e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:41.159643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-940bb193-8edc-4696-bd81-3163bb6ea36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:41.198801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cfd45-5106-45bc-91b1-c26c443a4e89 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:41.207043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:41.208201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:41.208696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:41.209226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:41.211319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:41.278715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:41.313473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1056/2121] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:41.321642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb193-8edc-4696-bd81-3163bb6ea36e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:41.350532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bb193-8edc-4696-bd81-3163bb6ea36e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:41.354416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:41.355900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:41.356638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:41.357578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:41.358080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:41.358455 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:41.370541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:41.372329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:41.386299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1066/2122] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:41.389520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1057/2123] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:41.784696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:41.786350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:41.799512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cefd-9aa5-4e6c-9da4-4be022612bd4 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:41.804349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192230a-2131-4442-a095-85e220238035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:41.805044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192230a-2131-4442-a095-85e220238035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:41.805315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192230a-2131-4442-a095-85e220238035 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:41.805587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192230a-2131-4442-a095-85e220238035 admin admin] PATH_INFO: `/v3/projects/5fbbabad77814d68bb193c8c8706d40f` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:41.806941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192230a-2131-4442-a095-85e220238035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbbabad77814d68bb193c8c8706d40f)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:41.809039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192230a-2131-4442-a095-85e220238035 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:41.867471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbbabad77814d68bb193c8c8706d40f', 'request_id': 'req-7192230a-2131-4442-a095-85e220238035'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.875220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbbabad77814d68bb193c8c8706d40f', 'request_id': 'req-7192230a-2131-4442-a095-85e220238035'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.883054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbbabad77814d68bb193c8c8706d40f', 'request_id': 'req-7192230a-2131-4442-a095-85e220238035'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.898714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7192230a-2131-4442-a095-85e220238035 admin admin] The token cache is being invalidate because project 5fbbabad77814d68bb193c8c8706d40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:41.899060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.899668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:41.901983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1067/2124] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:41 2022] DELETE /identity/v3/projects/5fbbabad77814d68bb193c8c8706d40f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:41.947536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:41.949125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:41.971223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234820c-0862-462a-9d52-d159c79455d0 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:42.014296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:42.019901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:42.134342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:42.135211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:42.135493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:42.135820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] PATH_INFO: `/v3/projects/95ec484bb2a24c4cb4d6cd261a39d4fc` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:42.137665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ec484bb2a24c4cb4d6cd261a39d4fc)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:42.141271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:42.159938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192230a-2131-4442-a095-85e220238035 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:42.167032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:42.167749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:42.168166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:42.168532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] PATH_INFO: `/v3/projects/77eb34c16e7646449256ec54780dec36` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:42.170099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77eb34c16e7646449256ec54780dec36)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:42.173741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:42.204555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ec484bb2a24c4cb4d6cd261a39d4fc', 'request_id': 'req-acb7e707-9682-4935-b716-a08a52e8153a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.208609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:42.215416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ec484bb2a24c4cb4d6cd261a39d4fc', 'request_id': 'req-acb7e707-9682-4935-b716-a08a52e8153a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.229532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ec484bb2a24c4cb4d6cd261a39d4fc', 'request_id': 'req-acb7e707-9682-4935-b716-a08a52e8153a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.243602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] The token cache is being invalidate because project 95ec484bb2a24c4cb4d6cd261a39d4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:42.243897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.244676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.246467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1058/2125] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:41 2022] DELETE /identity/v3/projects/95ec484bb2a24c4cb4d6cd261a39d4fc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:42.250716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:42.252649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:42.255120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77eb34c16e7646449256ec54780dec36', 'request_id': 'req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.270644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77eb34c16e7646449256ec54780dec36', 'request_id': 'req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.272176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:42.279935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77eb34c16e7646449256ec54780dec36', 'request_id': 'req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.297120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] The token cache is being invalidate because project 77eb34c16e7646449256ec54780dec36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:42.297493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.298199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.300046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1068/2126] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:42 2022] DELETE /identity/v3/projects/77eb34c16e7646449256ec54780dec36 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:42.304013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:42.306311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:42.340440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7e707-9682-4935-b716-a08a52e8153a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:42.385011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599c6c4-a626-48f5-a7ce-9e7d9f0e7133 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:42.390295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:42.391027 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:42.391382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:42.391891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] PATH_INFO: `/v3/users/1327bd76aca04804b9154231eb1c0dd1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:42.393190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1327bd76aca04804b9154231eb1c0dd1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:42.395327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:42.459953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:42.460796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:42.461107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:42.461401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] PATH_INFO: `/v3/users/398a4b22abb049cb92aded964df2f3ef` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:42.466019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398a4b22abb049cb92aded964df2f3ef)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:42.469596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:42.479933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1327bd76aca04804b9154231eb1c0dd1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.481451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1327bd76aca04804b9154231eb1c0dd1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.498735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1327bd76aca04804b9154231eb1c0dd1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.511368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1327bd76aca04804b9154231eb1c0dd1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.512142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1327bd76aca04804b9154231eb1c0dd1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.555246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1069/2127] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:42 2022] DELETE /identity/v3/users/1327bd76aca04804b9154231eb1c0dd1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:42.557747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398a4b22abb049cb92aded964df2f3ef'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.558828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398a4b22abb049cb92aded964df2f3ef'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.575543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398a4b22abb049cb92aded964df2f3ef'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.578275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398a4b22abb049cb92aded964df2f3ef'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.611022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398a4b22abb049cb92aded964df2f3ef'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:42.638730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1059/2128] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:42 2022] DELETE /identity/v3/users/398a4b22abb049cb92aded964df2f3ef => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:43.065141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.066957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:43.245402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc54e-da4d-4b61-8c33-24efac8c0331 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.257106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.258519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:43.261077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:43.266155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:43.330913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.331573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.331856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.332135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] PATH_INFO: `/v3/projects/22a761e297504dbdb14f73744fb3ebb3` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.333537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a761e297504dbdb14f73744fb3ebb3)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.335684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.420645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a761e297504dbdb14f73744fb3ebb3', 'request_id': 'req-ac433069-821d-4906-843a-485b9435eec7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.422783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bb331-bb95-4867-bed8-d6fc9eeb0a07 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.430094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a761e297504dbdb14f73744fb3ebb3', 'request_id': 'req-ac433069-821d-4906-843a-485b9435eec7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.443845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a761e297504dbdb14f73744fb3ebb3', 'request_id': 'req-ac433069-821d-4906-843a-485b9435eec7'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.472314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] The token cache is being invalidate because project 22a761e297504dbdb14f73744fb3ebb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:43.472616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.473338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ac433069-821d-4906-843a-485b9435eec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.478485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1070/2129] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:43 2022] DELETE /identity/v3/projects/22a761e297504dbdb14f73744fb3ebb3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:43.480091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f774f-6e95-45a7-81e3-e5848daa56ab None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.480387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f774f-6e95-45a7-81e3-e5848daa56ab None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.480669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f774f-6e95-45a7-81e3-e5848daa56ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.503933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.505132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.505591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.505974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] PATH_INFO: `/v3/projects/83d1e27907954cf08887a7a3f8454550` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.507464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d1e27907954cf08887a7a3f8454550)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.511221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.519435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-cc1f774f-6e95-45a7-81e3-e5848daa56ab None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:43.520816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cc1f774f-6e95-45a7-81e3-e5848daa56ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:43.542504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1071/2130] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:43.545433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aea60-c082-4e87-9840-1d1a4a14ada6 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.546427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aea60-c082-4e87-9840-1d1a4a14ada6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.546795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aea60-c082-4e87-9840-1d1a4a14ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.573960 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3c3aea60-c082-4e87-9840-1d1a4a14ada6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:43.575323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3c3aea60-c082-4e87-9840-1d1a4a14ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:43.576443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d1e27907954cf08887a7a3f8454550', 'request_id': 'req-470d509b-8edc-4747-a51d-6023ec55fef4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.591373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d1e27907954cf08887a7a3f8454550', 'request_id': 'req-470d509b-8edc-4747-a51d-6023ec55fef4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.599253 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d1e27907954cf08887a7a3f8454550', 'request_id': 'req-470d509b-8edc-4747-a51d-6023ec55fef4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.628299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] The token cache is being invalidate because project 83d1e27907954cf08887a7a3f8454550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:43.628700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.630998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-470d509b-8edc-4747-a51d-6023ec55fef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:43.632814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1060/2131] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:43 2022] DELETE /identity/v3/projects/83d1e27907954cf08887a7a3f8454550 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:43.637668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea0471-2913-47f2-85ea-24ab023b67c0 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.637958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea0471-2913-47f2-85ea-24ab023b67c0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.638367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea0471-2913-47f2-85ea-24ab023b67c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.668997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1072/2132] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:43.671216 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aea60-c082-4e87-9840-1d1a4a14ada6 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.671430 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-30ea0471-2913-47f2-85ea-24ab023b67c0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:43.672768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-30ea0471-2913-47f2-85ea-24ab023b67c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:43.681450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aea60-c082-4e87-9840-1d1a4a14ada6 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.682584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1061/2133] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:43.686799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.687576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.687948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.688289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.689525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:43.689525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.690937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a614-564c-4728-822f-cffa83a0ff3c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.691220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a614-564c-4728-822f-cffa83a0ff3c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.691318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.691652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0a614-564c-4728-822f-cffa83a0ff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.705879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1073/2134] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:43.710306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.716449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-74d0a614-564c-4728-822f-cffa83a0ff3c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:43.717875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-74d0a614-564c-4728-822f-cffa83a0ff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:43.721178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb99439-2d21-4184-9c2f-c1910fc2b8dc admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.726091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.726687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.730229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.730229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.730229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.730229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.730690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1062/2135] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:43.731705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a614-564c-4728-822f-cffa83a0ff3c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.747838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0a614-564c-4728-822f-cffa83a0ff3c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.747838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.747838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.747838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.748471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.748471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:43.748471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.749950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.752715 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:43.763396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1063/2136] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:43.765958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1074/2137] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:43.767877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.769812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.779767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c87fe0-230d-4727-b61e-b01fb6d43554 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.794134 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:43.837871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe5083-e903-4780-94e8-360ca3050ee1 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.843427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.844120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.844318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.844444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.844670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.844972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.845264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.845361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.845538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.846185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.847701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.848145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.875845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1075/2138] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:43.881687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.886245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1064/2139] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:43.887828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:43.892657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b25ec-1d6c-413d-b6ab-5b0ece5de0cb admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.965038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed9bce-107d-477b-9a52-4e4f0cc237ce admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:43.969020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034a934-75b7-408e-8064-3275490d4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.969731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a934-75b7-408e-8064-3275490d4144 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.970103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a934-75b7-408e-8064-3275490d4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.970445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034a934-75b7-408e-8064-3275490d4144 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.970662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:43.971261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a934-75b7-408e-8064-3275490d4144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.971415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.971765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.972120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.972851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:43.973226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034a934-75b7-408e-8064-3275490d4144 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.974999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:43.985659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1076/2140] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:43.990873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faed673-9358-47cc-9d3e-5df320574eb8 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:43.991176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faed673-9358-47cc-9d3e-5df320574eb8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:43.991458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faed673-9358-47cc-9d3e-5df320574eb8 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:43.993151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1077/2141] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:50:43.993949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faed673-9358-47cc-9d3e-5df320574eb8 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.002953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1065/2142] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:43 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:44.007127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.011636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faed673-9358-47cc-9d3e-5df320574eb8 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.017937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411734de-286b-477a-98db-f66696fd5df6 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.018176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.018820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.019201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.019572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.020355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.022110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.022888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.023584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.024012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.024167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.024814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.026564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.041358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1066/2143] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:44.041562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1078/2144] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:44.043157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.043314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.054345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786772d6-a35d-46af-8340-c37346493b73 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.054986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e1622-6c50-4aaf-a588-8eda879c32ab admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.059460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c499fd-bdb4-4174-a216-6bac10d17abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.060404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c499fd-bdb4-4174-a216-6bac10d17abc admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.060648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.061138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c499fd-bdb4-4174-a216-6bac10d17abc admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.061520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.061654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c499fd-bdb4-4174-a216-6bac10d17abc admin admin] PATH_INFO: `/v3/projects/a36c46ffacde4a12b8bbe63157145d85/users/9f3cc92857e6419fb74752bc238bb7a3/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.061808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.062086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.062746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.064402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.079797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c499fd-bdb4-4174-a216-6bac10d17abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36c46ffacde4a12b8bbe63157145d85, user_id=9f3cc92857e6419fb74752bc238bb7a3, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.081108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1067/2145] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:44.082459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.083161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c499fd-bdb4-4174-a216-6bac10d17abc admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.094062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109337b-e092-4118-a768-d232b9f2e28f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.101115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1079/2146] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:44 2022] PUT /identity/v3/projects/a36c46ffacde4a12b8bbe63157145d85/users/9f3cc92857e6419fb74752bc238bb7a3/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:44.111505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951b069-e71f-4210-86d2-4f7989b2e8d3 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.111799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951b069-e71f-4210-86d2-4f7989b2e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.112099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951b069-e71f-4210-86d2-4f7989b2e8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.147614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9951b069-e71f-4210-86d2-4f7989b2e8d3 None None] MFA Rules not processed for user `9f3cc92857e6419fb74752bc238bb7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:44.149231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9951b069-e71f-4210-86d2-4f7989b2e8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.164730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5329b-13c5-43d6-a9ef-7a969e89ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.165348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5329b-13c5-43d6-a9ef-7a969e89ea97 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.165632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5329b-13c5-43d6-a9ef-7a969e89ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.165911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5329b-13c5-43d6-a9ef-7a969e89ea97 admin admin] PATH_INFO: `/v3/projects/9704ffeea8964271ab40a787df9bf0a7/users/2897301aa593402b9c259dbbf9358dbf/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.180776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:44.184671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5329b-13c5-43d6-a9ef-7a969e89ea97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9704ffeea8964271ab40a787df9bf0a7, user_id=2897301aa593402b9c259dbbf9358dbf, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.187558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5329b-13c5-43d6-a9ef-7a969e89ea97 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.203317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1068/2147] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:44 2022] PUT /identity/v3/projects/9704ffeea8964271ab40a787df9bf0a7/users/2897301aa593402b9c259dbbf9358dbf/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:44.205466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:44.208296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.208585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.208909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.230384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:44.231614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.243731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1080/2148] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:44.243731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.243731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.245075 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.275164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:44.277496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.329000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1069/2149] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:44.329900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.331161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.354553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1081/2150] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:44.355409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.356758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.370046 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbae81-e61c-4bd6-a31b-7e98e8fad18e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.374999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.375904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.375904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.376178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] PATH_INFO: `/v3/users/8f581ef77233477cbfdb987c3b2508ac` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.377349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f581ef77233477cbfdb987c3b2508ac)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.379290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.392263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aada6-1ff3-45f2-8378-0cd5d0ed15f0 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.396026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.396652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.396935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.397212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.427586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f581ef77233477cbfdb987c3b2508ac'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.428251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f581ef77233477cbfdb987c3b2508ac'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.435517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f581ef77233477cbfdb987c3b2508ac'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.444695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f581ef77233477cbfdb987c3b2508ac'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.445617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f581ef77233477cbfdb987c3b2508ac'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.458233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.459621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.463321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1082/2151] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:44 2022] DELETE /identity/v3/users/8f581ef77233477cbfdb987c3b2508ac => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:44.464202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.465681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.472800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1070/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:44.473985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.475504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.502531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bedcb2-debb-48fc-ab5d-41b661c78187 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.550839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:44.559882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0d2aa-042f-4ee1-b983-fead9658c984 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.572307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.573015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.573244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.573514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.575318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.581240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:44.605190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.606228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.606647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.607230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.609447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.622784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.624407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.636659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1071/2153] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:44.637689 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.639451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.646097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.647630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.658689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1083/2154] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:44.667360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed045ca-a3af-4e2c-a4b4-5d9f9be384cf service placement] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.674375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.674857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.675140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.675414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] PATH_INFO: `/v3/users/9f3cc92857e6419fb74752bc238bb7a3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.676714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3cc92857e6419fb74752bc238bb7a3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.678893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.718427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.724030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.759289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816e6a-33a2-4f48-94a8-d4c1b949c518 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:44.768607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:44.770289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.770586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.770979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] PATH_INFO: `/v3/projects/d6e5bb1a3f06498faeafe051fd853ef3` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.772485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e5bb1a3f06498faeafe051fd853ef3)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:44.775769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:44.784607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3cc92857e6419fb74752bc238bb7a3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.786249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3cc92857e6419fb74752bc238bb7a3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.820213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3cc92857e6419fb74752bc238bb7a3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.821291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3cc92857e6419fb74752bc238bb7a3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.842910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc151aa7-4038-45c7-889c-54c646ee233d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3cc92857e6419fb74752bc238bb7a3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.846841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e5bb1a3f06498faeafe051fd853ef3', 'request_id': 'req-b01b2359-eafe-46f6-b305-93bf69b6b769'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.855100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e5bb1a3f06498faeafe051fd853ef3', 'request_id': 'req-b01b2359-eafe-46f6-b305-93bf69b6b769'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.858485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1072/2155] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:44 2022] DELETE /identity/v3/users/9f3cc92857e6419fb74752bc238bb7a3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:44.863301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.863755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.864101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.867819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e5bb1a3f06498faeafe051fd853ef3', 'request_id': 'req-b01b2359-eafe-46f6-b305-93bf69b6b769'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.890747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] The token cache is being invalidate because project d6e5bb1a3f06498faeafe051fd853ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:44.891083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.891827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b01b2359-eafe-46f6-b305-93bf69b6b769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:44.891935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:44.893428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.894603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1084/2156] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:44 2022] DELETE /identity/v3/projects/d6e5bb1a3f06498faeafe051fd853ef3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:44.903550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ad84e-4ae9-4db4-9a68-d59e7255c376 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:44.904024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ad84e-4ae9-4db4-9a68-d59e7255c376 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:44.904604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ad84e-4ae9-4db4-9a68-d59e7255c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:44.934195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-598ad84e-4ae9-4db4-9a68-d59e7255c376 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:44.936088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-598ad84e-4ae9-4db4-9a68-d59e7255c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:44.986620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1073/2157] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:44.995237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:44.997562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:45.059021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1085/2158] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:45.059021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0898-8acf-46fa-a89d-bc0332c2ef31 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.059021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0898-8acf-46fa-a89d-bc0332c2ef31 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.059021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0898-8acf-46fa-a89d-bc0332c2ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.073775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:45.075765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a6da-57a0-4377-ad9f-07da8f386cc5 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.081388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.082382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.082877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.083519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.097183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.098184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8b9b0898-8acf-46fa-a89d-bc0332c2ef31 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:45.099187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.099421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8b9b0898-8acf-46fa-a89d-bc0332c2ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:45.119682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1074/2159] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:45.128736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1086/2160] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:45.133631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:45.151959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef13fe-ba3a-48d0-b047-4bfee76573b6 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.177905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.178549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.178828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.179098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.179785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:45.180101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.182367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.196993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1075/2161] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:45.202251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0898-8acf-46fa-a89d-bc0332c2ef31 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:45.212546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0898-8acf-46fa-a89d-bc0332c2ef31 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.219934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.221362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.221362 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.228370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.229458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.232068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.260390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:45.296266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1087/2162] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:45 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:45.297416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:45.323759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b80b-11fa-443d-bd7a-d6469d87de56 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.437769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.438496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.438865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.439195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.445638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.448411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.506304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1076/2163] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:45 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:45.508694 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:45.526718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ac43-eadf-4ca8-862f-717ccf72fcf6 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.540969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.541581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.541867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.542146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.542907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.544674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.569875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1088/2164] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:45.574068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:45.587698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdbabc-8ef2-4ecd-98f2-f219a00f0e03 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.601953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.602582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.603294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.603582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.604243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.605951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.622607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:45.625074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:45.640642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1077/2165] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:45.644161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:45.651250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333ac01-6065-4679-8c8d-176d1e6a98e2 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.664647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d1546-d0a8-4117-833f-a430ff4dc383 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:45.673575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e308a4-25f5-4dfe-8568-6ba9b0794f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.674265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e308a4-25f5-4dfe-8568-6ba9b0794f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.674542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e308a4-25f5-4dfe-8568-6ba9b0794f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.674815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e308a4-25f5-4dfe-8568-6ba9b0794f18 admin admin] PATH_INFO: `/v3/projects/bbca560419114360898754378d57ac9d/users/efb98c8e757344aa9b01ad32fdbb8906/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.680751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:45.681653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.682087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.682510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] PATH_INFO: `/v3/projects/a36c46ffacde4a12b8bbe63157145d85` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.684079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36c46ffacde4a12b8bbe63157145d85)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.689721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.696544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e308a4-25f5-4dfe-8568-6ba9b0794f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbca560419114360898754378d57ac9d, user_id=efb98c8e757344aa9b01ad32fdbb8906, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:45.699515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e308a4-25f5-4dfe-8568-6ba9b0794f18 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:45.717387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1078/2166] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:45 2022] PUT /identity/v3/projects/bbca560419114360898754378d57ac9d/users/efb98c8e757344aa9b01ad32fdbb8906/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:45.718803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf214bc-5433-4f1b-81f0-d099a0631ec6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.719091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf214bc-5433-4f1b-81f0-d099a0631ec6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.719365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf214bc-5433-4f1b-81f0-d099a0631ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.769486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-aaf214bc-5433-4f1b-81f0-d099a0631ec6 None None] MFA Rules not processed for user `2897301aa593402b9c259dbbf9358dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:45.770820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aaf214bc-5433-4f1b-81f0-d099a0631ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:45.778995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36c46ffacde4a12b8bbe63157145d85', 'request_id': 'req-e9c66cd3-0af0-487c-a0c4-5520185ff617'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:45.792091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36c46ffacde4a12b8bbe63157145d85', 'request_id': 'req-e9c66cd3-0af0-487c-a0c4-5520185ff617'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:45.808961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36c46ffacde4a12b8bbe63157145d85', 'request_id': 'req-e9c66cd3-0af0-487c-a0c4-5520185ff617'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:45.837413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] The token cache is being invalidate because project a36c46ffacde4a12b8bbe63157145d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:45.837714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:45.838909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e9c66cd3-0af0-487c-a0c4-5520185ff617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:45.841231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1089/2167] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:45 2022] DELETE /identity/v3/projects/a36c46ffacde4a12b8bbe63157145d85 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:45.844522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.844522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.844522 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.871095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:45.873175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:45.882701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1079/2168] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:45.883675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:45.885565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:45.886599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:45.949784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:45.954320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:46.003911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:46.006395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1090/2169] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:46.008380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.017161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:46.030398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e510b-d16f-4a96-965e-0a0b9ac341ca None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.035199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1bc1b-ede1-4cfa-8fda-2730e6b151d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.035908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1bc1b-ede1-4cfa-8fda-2730e6b151d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.036254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1bc1b-ede1-4cfa-8fda-2730e6b151d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.036595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1bc1b-ede1-4cfa-8fda-2730e6b151d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.037524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1bc1b-ede1-4cfa-8fda-2730e6b151d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.039756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1bc1b-ede1-4cfa-8fda-2730e6b151d6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.055575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1080/2170] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:46.056574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.058723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:46.071928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1091/2171] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:46.073096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534e6c7-baa2-4d64-b6a8-4b9f06b5cb18 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.073382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534e6c7-baa2-4d64-b6a8-4b9f06b5cb18 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.073662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534e6c7-baa2-4d64-b6a8-4b9f06b5cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.093058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4534e6c7-baa2-4d64-b6a8-4b9f06b5cb18 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:46.094280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4534e6c7-baa2-4d64-b6a8-4b9f06b5cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:46.120212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd986c-4c37-454b-bff9-33d64115f272 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.133922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:46.164870 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1092/2172] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:46.165746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534e6c7-baa2-4d64-b6a8-4b9f06b5cb18 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.176184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534e6c7-baa2-4d64-b6a8-4b9f06b5cb18 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.176615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.177291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.177571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.177894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.181068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.181658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.181934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.182207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.182836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.184788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.187272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.188717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.202052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1081/2173] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:46.202959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.212709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dee7a-e2a5-43a5-92c3-8411c221e300 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.213185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1093/2174] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:46.217689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.221691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.222417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.222758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.223237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.224025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:46.224405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.226415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.230124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45dd98-e087-4578-9f32-fb04d9b623c6 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.235526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.236144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.236428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.236873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.237608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.239211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.245752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1082/2175] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:46.247099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.251587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1094/2176] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:46.257764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.260063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323c4a7-6c94-4c03-a70a-6221c2df1b78 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.266720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.267556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.268006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.268282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.268451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a8be6-d9af-4af7-92a5-e88dc60c7d49 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.269195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.271665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.283952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.285569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.286261 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.286617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] PATH_INFO: `/v3/projects/6465498d450a4c058e2a1e37b56580c7/users/d6e0b20e020b4a5d8954fe834e378069/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.307564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6465498d450a4c058e2a1e37b56580c7, user_id=d6e0b20e020b4a5d8954fe834e378069, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.311663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1083/2177] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:46.311765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.313522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.326616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1095/2178] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:46 2022] PUT /identity/v3/projects/6465498d450a4c058e2a1e37b56580c7/users/d6e0b20e020b4a5d8954fe834e378069/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:46.330807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.368803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:46.391303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a8053-8a56-4c43-9d4e-6d4e89d888a8 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.410549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001753bd-9e2b-4b6f-a139-6d3b38f55e73 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.417673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.419137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.419137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.419709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.420531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.422874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.437040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1096/2179] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:46.441509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.455445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45dfc8-965b-4481-af32-c80d783d4231 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.461483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.462286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.462761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.463044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] PATH_INFO: `/v3/projects/6465498d450a4c058e2a1e37b56580c7/users/d6e0b20e020b4a5d8954fe834e378069/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.467195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6465498d450a4c058e2a1e37b56580c7, user_id=d6e0b20e020b4a5d8954fe834e378069, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.470590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.481438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.482322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.482580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.483103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.484962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1097/2180] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:46 2022] PUT /identity/v3/projects/6465498d450a4c058e2a1e37b56580c7/users/d6e0b20e020b4a5d8954fe834e378069/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:46.485087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.486261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.516983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1084/2181] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:46.519503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.622706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7b8b-7b80-4610-8b72-8e5c26716d4f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.629066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.629905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.630623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.630623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.631072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.632767 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.644816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1098/2182] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:46.650396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.663055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c910a6-3ce7-4e16-808f-79accb122f96 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.668838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42252f-fb05-4988-8445-80731a78d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.669788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42252f-fb05-4988-8445-80731a78d529 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.670090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42252f-fb05-4988-8445-80731a78d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.670363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42252f-fb05-4988-8445-80731a78d529 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.671018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42252f-fb05-4988-8445-80731a78d529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.673064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42252f-fb05-4988-8445-80731a78d529 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.685521 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1085/2183] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:46.690672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.705897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42f98e-f91a-45d8-a5ea-e43f5929998b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.711256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.712001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.712291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.712564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] PATH_INFO: `/v3/projects/4f5ff53d0c85495fb39025a4c21de461/users/fc577741b59a4031b38d8f5e5d72d4ea/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.716611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:46.736644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ff53d0c85495fb39025a4c21de461, user_id=fc577741b59a4031b38d8f5e5d72d4ea, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.739755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.753349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1099/2184] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:46 2022] PUT /identity/v3/projects/4f5ff53d0c85495fb39025a4c21de461/users/fc577741b59a4031b38d8f5e5d72d4ea/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:46.766025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e195-ad9a-4847-ad8e-9b08a7097355 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.766333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e195-ad9a-4847-ad8e-9b08a7097355 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.766605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e195-ad9a-4847-ad8e-9b08a7097355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.797029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2bd5e195-ad9a-4847-ad8e-9b08a7097355 None None] MFA Rules not processed for user `fc577741b59a4031b38d8f5e5d72d4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:46.798375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2bd5e195-ad9a-4847-ad8e-9b08a7097355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:46.869486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1086/2185] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:46.874167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:46.946532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a40214-6aa4-499b-a957-d4f754ba51bb admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:46.952050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:46.952672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:46.952980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:46.953255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:46.954007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:46.955998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:46.993348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1100/2186] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:50:46.997392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e195-ad9a-4847-ad8e-9b08a7097355 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.021789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e195-ad9a-4847-ad8e-9b08a7097355 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.101656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.103103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.103586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.104117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.105224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.107664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.117299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:47.131146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1087/2187] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:46 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:47.136521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.147320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c22a4-2a4d-4aa7-a846-c53606e638de admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.152578 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.153224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.153504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.153857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.154526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.156140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.183543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.184429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1101/2188] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:47.192533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b2f4b-c2e8-4662-8c4a-592164f0c1d2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.199798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ffdaa-f46d-4bc5-9531-2aed35246391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.205055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ffdaa-f46d-4bc5-9531-2aed35246391 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.205055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ffdaa-f46d-4bc5-9531-2aed35246391 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.205055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ffdaa-f46d-4bc5-9531-2aed35246391 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.206540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ffdaa-f46d-4bc5-9531-2aed35246391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.208554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ffdaa-f46d-4bc5-9531-2aed35246391 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.233608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1088/2189] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:47.234251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.260074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9ef48-add6-4d94-8ae0-931435ce94b1 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.274929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.275619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.275900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.276173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] PATH_INFO: `/v3/projects/6633d8bb7e0143cbb5ea333b48f5a5a4/users/870217184cec47fe9df0c4f7d0297e2f/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.303874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6633d8bb7e0143cbb5ea333b48f5a5a4, user_id=870217184cec47fe9df0c4f7d0297e2f, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.307988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.331503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1102/2190] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:47 2022] PUT /identity/v3/projects/6633d8bb7e0143cbb5ea333b48f5a5a4/users/870217184cec47fe9df0c4f7d0297e2f/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:47.342148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911afa-58cb-492d-a1a8-5a08e9cd14d7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.342585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911afa-58cb-492d-a1a8-5a08e9cd14d7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.342941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2911afa-58cb-492d-a1a8-5a08e9cd14d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.378885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f2911afa-58cb-492d-a1a8-5a08e9cd14d7 None None] MFA Rules not processed for user `870217184cec47fe9df0c4f7d0297e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:47.380333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f2911afa-58cb-492d-a1a8-5a08e9cd14d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:47.490037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1089/2191] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:47.494521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.612890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb0107-500a-4add-a793-a567c54902ce admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.629804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.630553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.630825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.631102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.631782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.633747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.647856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984424-e6b6-4703-a762-f948ac730885 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.648431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984424-e6b6-4703-a762-f948ac730885 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.648431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984424-e6b6-4703-a762-f948ac730885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.696718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1103/2192] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:47 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:47.697594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-dd984424-e6b6-4703-a762-f948ac730885 None None] MFA Rules not processed for user `d6e0b20e020b4a5d8954fe834e378069`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:47.699715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-dd984424-e6b6-4703-a762-f948ac730885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:47.704108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.737211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:47.795051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1008a-a904-47b5-8d58-2f925f9dcae1 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.800809 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.801797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.802202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.802667 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.803478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.806076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.833290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1090/2193] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:47.835414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1104/2194] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:47 2022] POST /identity/v3/users => generated 298 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:47.837783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.838379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.838661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.839801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.865028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d523-0006-4026-8551-ef7107bde203 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.872274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] MFA Rules not processed for user `2897301aa593402b9c259dbbf9358dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:47.874157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:47.874599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.875519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.876265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.876853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.877734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.879853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.894761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1105/2195] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:47.898780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.913990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d022a-58f2-495f-bdb4-0c3a4c931881 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:47.919865 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:47.920759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:47.921138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:47.921486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] PATH_INFO: `/v3/projects/b4a4beb934dc4fa0a4968c5e46a9bdbb/users/d927867607d34f0697b6a68bfe048091/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:47.930672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:47.941396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1091/2196] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:47.949868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a4beb934dc4fa0a4968c5e46a9bdbb, user_id=d927867607d34f0697b6a68bfe048091, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:47.953062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:47.953511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:47.955900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:47.977499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1106/2197] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:47 2022] PUT /identity/v3/projects/b4a4beb934dc4fa0a4968c5e46a9bdbb/users/d927867607d34f0697b6a68bfe048091/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:47.982852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:48.116476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59f42f-d8e9-4575-9088-12a065940cce None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:48.133964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327307-4cec-41bf-b418-c556120f2925 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:48.147101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:48.148775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:48.149116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:48.149673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:48.150714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:48.152746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:48.171627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1107/2198] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:50:48.172798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:48.183359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3123d62-955e-447d-8538-ba337ec9b1c4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:48.188946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ee3e2-0095-4e32-8ebd-2a74ee34c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:48.190091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee3e2-0095-4e32-8ebd-2a74ee34c09f admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:48.190817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee3e2-0095-4e32-8ebd-2a74ee34c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:48.191125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee3e2-0095-4e32-8ebd-2a74ee34c09f admin admin] PATH_INFO: `/v3/projects/b4a4beb934dc4fa0a4968c5e46a9bdbb/users/d927867607d34f0697b6a68bfe048091/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:48.194353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ee3e2-0095-4e32-8ebd-2a74ee34c09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a4beb934dc4fa0a4968c5e46a9bdbb, user_id=d927867607d34f0697b6a68bfe048091, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:48.202537 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ee3e2-0095-4e32-8ebd-2a74ee34c09f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:48.214861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1108/2199] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:48 2022] PUT /identity/v3/projects/b4a4beb934dc4fa0a4968c5e46a9bdbb/users/d927867607d34f0697b6a68bfe048091/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:48.228574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:48.228985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:48.229379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:48.265306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] MFA Rules not processed for user `d927867607d34f0697b6a68bfe048091`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:48.265513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:48.266090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:48.266371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:48.266570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:48.266667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:48.350896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:48.408535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1109/2200] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:48.425348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:48.425667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:48.427508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:48.436566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:48.444041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1092/2201] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:48.523302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c913465-266b-4df8-bf65-d24b705abff0 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:48.537089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:48.538290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:48.538730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:48.539009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:48.618978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:48.620535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:48.636426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1110/2202] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:50.493679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:50.495722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:50.561593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:50.584582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261721f-ec78-41d9-a85b-9a32927a59b6 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:50.588782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d209d-a2a4-4d0e-a0d3-70b1c4c56bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:50.589898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d209d-a2a4-4d0e-a0d3-70b1c4c56bbd service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:50.590186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d209d-a2a4-4d0e-a0d3-70b1c4c56bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:50.590609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d209d-a2a4-4d0e-a0d3-70b1c4c56bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:50.666012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d209d-a2a4-4d0e-a0d3-70b1c4c56bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:50.667619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d209d-a2a4-4d0e-a0d3-70b1c4c56bbd service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:50.679469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1093/2203] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:51.723557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:51.738863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e32fa-4b6b-4ba3-8c95-7cd33e57b8f9 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:51.750502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:51.751138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:51.751421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:51.751733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:51.772504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:51.775068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:51.801355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1111/2204] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:52.079480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d6fb-8bba-4eb7-b424-7c1b5ace25da None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:52.081524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d6fb-8bba-4eb7-b424-7c1b5ace25da None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:52.082144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d6fb-8bba-4eb7-b424-7c1b5ace25da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:52.129234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7a39d6fb-8bba-4eb7-b424-7c1b5ace25da None None] MFA Rules not processed for user `efb98c8e757344aa9b01ad32fdbb8906`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:52.130666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7a39d6fb-8bba-4eb7-b424-7c1b5ace25da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:52.223382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1094/2205] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:52.238962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:52.240587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:52.342895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cad49-284d-43b0-8cdd-9b08bb2b61c5 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:52.371713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:52.372615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:52.373006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:52.373844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:52.382693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:52.384293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:52.396953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1112/2206] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:50:54.715532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d778df-a7d2-4c07-9f49-b0ff170be310 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:54.716166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d778df-a7d2-4c07-9f49-b0ff170be310 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:54.716249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d778df-a7d2-4c07-9f49-b0ff170be310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:54.749888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d2d778df-a7d2-4c07-9f49-b0ff170be310 None None] MFA Rules not processed for user `efb98c8e757344aa9b01ad32fdbb8906`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:54.751298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d2d778df-a7d2-4c07-9f49-b0ff170be310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:54.760969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1095/2207] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:56.130273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:56.143004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:56.237164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c092-c0e5-47e1-9d16-3947c43aed5b service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:56.241829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:56.242485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:56.242766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:56.243102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] PATH_INFO: `/v3/users/fc577741b59a4031b38d8f5e5d72d4ea` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:56.244259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc577741b59a4031b38d8f5e5d72d4ea)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:56.246247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:56.299010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc577741b59a4031b38d8f5e5d72d4ea'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:56.299658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc577741b59a4031b38d8f5e5d72d4ea'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:56.311567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc577741b59a4031b38d8f5e5d72d4ea'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:56.320799 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc577741b59a4031b38d8f5e5d72d4ea'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:56.321554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc577741b59a4031b38d8f5e5d72d4ea'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:56.341372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1113/2208] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:56 2022] DELETE /identity/v3/users/fc577741b59a4031b38d8f5e5d72d4ea => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:56.346122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:56.346573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:56.346780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:56.367272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:56.369283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:56.436376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1096/2209] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:56.446256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:56.447705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:56.524311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfed1f-7e4d-46a8-9e14-441d9cd87bdc admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:56.527998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:56.528709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:56.529229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:56.529670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:56.539784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:56.541312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:56.552098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1114/2210] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:50:56.914312 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:56.915797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:56.947555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec744-b6d6-4b60-aa67-bc3fed65b05d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:56.947555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:56.947809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:56.947880 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:56.948196 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] PATH_INFO: `/v3/projects/4f5ff53d0c85495fb39025a4c21de461` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:56.957790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5ff53d0c85495fb39025a4c21de461)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:56.959772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:56.973298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:57.021351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5ff53d0c85495fb39025a4c21de461', 'request_id': 'req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.029380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5ff53d0c85495fb39025a4c21de461', 'request_id': 'req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.035082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5ff53d0c85495fb39025a4c21de461', 'request_id': 'req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.047198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] The token cache is being invalidate because project 4f5ff53d0c85495fb39025a4c21de461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:57.047589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.048327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.050554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1097/2211] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:56 2022] DELETE /identity/v3/projects/4f5ff53d0c85495fb39025a4c21de461 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:57.055002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:57.064857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d24a8c-5c9f-4cbc-ac63-a00fbbe89b6a service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:57.098595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:57.130371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:57.131047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:57.131376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:57.131663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] PATH_INFO: `/v3/users/870217184cec47fe9df0c4f7d0297e2f` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:57.132905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870217184cec47fe9df0c4f7d0297e2f)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:57.135014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:57.191802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870217184cec47fe9df0c4f7d0297e2f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.192542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870217184cec47fe9df0c4f7d0297e2f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.199956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870217184cec47fe9df0c4f7d0297e2f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.208251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870217184cec47fe9df0c4f7d0297e2f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.208986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870217184cec47fe9df0c4f7d0297e2f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.233859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1115/2212] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:57 2022] DELETE /identity/v3/users/870217184cec47fe9df0c4f7d0297e2f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:50:57.541666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:57.543258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:57.558018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cab0c-847b-4e9a-8c2f-ed07bf9c7b67 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:57.618469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:57.619126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:57.619368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:57.619639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] PATH_INFO: `/v3/projects/6633d8bb7e0143cbb5ea333b48f5a5a4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:57.620805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6633d8bb7e0143cbb5ea333b48f5a5a4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:57.622870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:57.674104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6633d8bb7e0143cbb5ea333b48f5a5a4', 'request_id': 'req-f23de7fc-6363-488f-b150-3601f6e615d7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.684068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6633d8bb7e0143cbb5ea333b48f5a5a4', 'request_id': 'req-f23de7fc-6363-488f-b150-3601f6e615d7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.692511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6633d8bb7e0143cbb5ea333b48f5a5a4', 'request_id': 'req-f23de7fc-6363-488f-b150-3601f6e615d7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.708342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] The token cache is being invalidate because project 6633d8bb7e0143cbb5ea333b48f5a5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:57.708663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.709373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.710944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1098/2213] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:57 2022] DELETE /identity/v3/projects/6633d8bb7e0143cbb5ea333b48f5a5a4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:57.715038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:57.716983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:57.731370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfc81-e6ef-459c-8b1a-b83ede9bd755 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:57.805842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:57.806427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:57.806713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:57.806993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] PATH_INFO: `/v3/users/d927867607d34f0697b6a68bfe048091` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:57.808217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d927867607d34f0697b6a68bfe048091)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:57.810669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:57.895351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd927867607d34f0697b6a68bfe048091'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.896252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd927867607d34f0697b6a68bfe048091'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.903615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:57.908885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd927867607d34f0697b6a68bfe048091'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.920238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd927867607d34f0697b6a68bfe048091'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.921970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-77e41cb3-1a59-4e45-8b08-2795e4c600e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd927867607d34f0697b6a68bfe048091'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:57.968840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1116/2214] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:50:57 2022] DELETE /identity/v3/users/d927867607d34f0697b6a68bfe048091 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:58.346682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:58.348222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:58.362499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23de7fc-6363-488f-b150-3601f6e615d7 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:58.392087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:58.427264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:58.427936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.428210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.428479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] PATH_INFO: `/v3/projects/b4a4beb934dc4fa0a4968c5e46a9bdbb` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.430010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a4beb934dc4fa0a4968c5e46a9bdbb)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:58.432138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:58.486908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a4beb934dc4fa0a4968c5e46a9bdbb', 'request_id': 'req-0fce1a57-0dd7-4899-8536-a529dc49c87e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:58.496462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a4beb934dc4fa0a4968c5e46a9bdbb', 'request_id': 'req-0fce1a57-0dd7-4899-8536-a529dc49c87e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:58.503431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a4beb934dc4fa0a4968c5e46a9bdbb', 'request_id': 'req-0fce1a57-0dd7-4899-8536-a529dc49c87e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:58.515885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] The token cache is being invalidate because project b4a4beb934dc4fa0a4968c5e46a9bdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:50:58.516759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:58.517802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0fce1a57-0dd7-4899-8536-a529dc49c87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:50:58.525775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1099/2215] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:50:58 2022] DELETE /identity/v3/projects/b4a4beb934dc4fa0a4968c5e46a9bdbb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:58.527900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564011-7075-4c90-b988-16b80fafbc2b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.528405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564011-7075-4c90-b988-16b80fafbc2b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.528641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9564011-7075-4c90-b988-16b80fafbc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.552855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a9564011-7075-4c90-b988-16b80fafbc2b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:58.554069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a9564011-7075-4c90-b988-16b80fafbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:58.631116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1117/2216] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:50:58.638971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f79d-8166-4bc5-ab2c-937e111e4d4e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.639451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f79d-8166-4bc5-ab2c-937e111e4d4e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.639564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f79d-8166-4bc5-ab2c-937e111e4d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.659552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b5e1f79d-8166-4bc5-ab2c-937e111e4d4e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:58.660779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b5e1f79d-8166-4bc5-ab2c-937e111e4d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:58.669186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1100/2217] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:58.673676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9564011-7075-4c90-b988-16b80fafbc2b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:58.684210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9564011-7075-4c90-b988-16b80fafbc2b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:58.690323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:58.690984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.691259 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.691540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.692204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:50:58.692513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:58.694276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:58.710507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1118/2218] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:50:58.715009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f79d-8166-4bc5-ab2c-937e111e4d4e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:58.725572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f79d-8166-4bc5-ab2c-937e111e4d4e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:58.732000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:58.732797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.733218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.733561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.734266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:58.736444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:58.769741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1101/2219] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:50:58 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:58.774125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:58.785758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45961453-ad63-46e1-91af-0742171afe98 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:58.852105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:58.853174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.853516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.853843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.854568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:58.856661 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:58.886969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1119/2220] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:50:58 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:50:58.888231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:58.907476 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c24862-03af-4364-9cbe-7c388b5a4488 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:58.914605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:58.915265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.915531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.915977 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.917358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:58.919401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:58.934379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1102/2221] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:58.939341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:58.974254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9da6b-4bc3-45ba-bb9d-8616e00f4bf6 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:58.996839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daece1f-b931-4e97-8271-86e84aa869e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:58.997751 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daece1f-b931-4e97-8271-86e84aa869e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:58.998104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daece1f-b931-4e97-8271-86e84aa869e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:58.998445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daece1f-b931-4e97-8271-86e84aa869e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:58.999225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daece1f-b931-4e97-8271-86e84aa869e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:59.000961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daece1f-b931-4e97-8271-86e84aa869e2 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:59.016971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1120/2222] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:50:59.022124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:59.033435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4ecc1-9c04-4942-8dcd-31c49cfdb2a9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:59.038298 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:59.038986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:59.039252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:59.039527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] PATH_INFO: `/v3/projects/0f1130b2e2244aaeb2ed29888a5863f2/users/5c3a493331c9414e9c9493d90852b8dc/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:59.055039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1130b2e2244aaeb2ed29888a5863f2, user_id=5c3a493331c9414e9c9493d90852b8dc, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:59.057772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:59.075210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1103/2223] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:50:59 2022] PUT /identity/v3/projects/0f1130b2e2244aaeb2ed29888a5863f2/users/5c3a493331c9414e9c9493d90852b8dc/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:50:59.080341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8bce-8ddd-4d8d-b97f-11c174cee921 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:59.080628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8bce-8ddd-4d8d-b97f-11c174cee921 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:59.080905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf8bce-8ddd-4d8d-b97f-11c174cee921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:59.101923 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-48bf8bce-8ddd-4d8d-b97f-11c174cee921 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:50:59.103531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-48bf8bce-8ddd-4d8d-b97f-11c174cee921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:59.139985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:59.188512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1121/2224] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:50:59.199159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:50:59.201840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:50:59.276278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ea0b-10c6-4205-b06e-2dede678560c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:50:59.305952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:50:59.306601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:50:59.306884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:50:59.307154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:50:59.316561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:50:59.320487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:50:59.322980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:50:59.337959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1104/2225] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:00.111992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002a62d-c91c-4401-8090-94598aea6d8c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:00.112530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002a62d-c91c-4401-8090-94598aea6d8c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:00.112653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002a62d-c91c-4401-8090-94598aea6d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:00.144728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7002a62d-c91c-4401-8090-94598aea6d8c None None] MFA Rules not processed for user `5c3a493331c9414e9c9493d90852b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:00.145987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7002a62d-c91c-4401-8090-94598aea6d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:00.238942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1122/2226] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:00.251385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:00.253146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:00.328148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b7f1-0d8a-453f-a6c0-b54e3cfda03b service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:00.333050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:00.334280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:00.334593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:00.334973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:00.346670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:00.349348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:00.360285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1105/2227] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:01.840993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91e66-99cc-463b-8c62-69d821dd4f41 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:01.841529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91e66-99cc-463b-8c62-69d821dd4f41 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:01.841766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa91e66-99cc-463b-8c62-69d821dd4f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:01.861603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-aaa91e66-99cc-463b-8c62-69d821dd4f41 None None] MFA Rules not processed for user `5c3a493331c9414e9c9493d90852b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:01.862817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-aaa91e66-99cc-463b-8c62-69d821dd4f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:01.869953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1123/2228] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:10.053848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:10.055408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:10.067454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051021-ab69-4287-bcaf-ca2ab8bacfcc service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:10.071153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:10.071760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:10.072061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:10.072567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:10.074387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:10.143035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:10.144524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:10.155131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1106/2229] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:11.856095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=46 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:17.238934 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8e13-7d6f-476c-a2fe-fe9ff77b3692 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:17.239929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8e13-7d6f-476c-a2fe-fe9ff77b3692 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:17.239929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8e13-7d6f-476c-a2fe-fe9ff77b3692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:17.266466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4aca8e13-7d6f-476c-a2fe-fe9ff77b3692 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:17.267984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4aca8e13-7d6f-476c-a2fe-fe9ff77b3692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:17.278398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1124/2230] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:17.294988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:17.296496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:17.374867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd63404-d7ee-48da-b790-46f52a4d8cd9 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:17.381063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:17.381707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:17.381992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:17.382338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:17.391243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:17.393088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:17.403242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1107/2231] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:24.471302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a022-34fc-4c2f-8498-d1f7b8659961 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:24.471783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a022-34fc-4c2f-8498-d1f7b8659961 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:24.471907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a022-34fc-4c2f-8498-d1f7b8659961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:24.493892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2188a022-34fc-4c2f-8498-d1f7b8659961 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:24.495151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2188a022-34fc-4c2f-8498-d1f7b8659961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:24.506234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1125/2232] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:24.542512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:24.544264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:24.563800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fac9a-ee5b-4eff-8268-08b5c4bb3de5 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:24.571255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:24.572078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:24.572355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:24.572670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:24.587889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:24.589583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:24.600748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1108/2233] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:30.829049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9add-cf2d-4ac9-85aa-60324e7874f1 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:30.829518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9add-cf2d-4ac9-85aa-60324e7874f1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:30.829719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9add-cf2d-4ac9-85aa-60324e7874f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:30.850941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-620b9add-cf2d-4ac9-85aa-60324e7874f1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:30.852573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-620b9add-cf2d-4ac9-85aa-60324e7874f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:30.860756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1126/2234] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:30.887073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:30.893087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=99 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:30.900507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f91929-f077-4dd4-aef2-00b3d7de3ca0 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:30.906471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed0add-9a4a-46a3-9c45-05c46eafa510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:30.907308 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0add-9a4a-46a3-9c45-05c46eafa510 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:30.907593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0add-9a4a-46a3-9c45-05c46eafa510 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:30.907866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0add-9a4a-46a3-9c45-05c46eafa510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:30.917155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0add-9a4a-46a3-9c45-05c46eafa510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:30.918722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed0add-9a4a-46a3-9c45-05c46eafa510 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:30.929053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1109/2235] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:33.045029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df858c-b0d2-40da-80e9-bcc60101f23e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:33.045521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df858c-b0d2-40da-80e9-bcc60101f23e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:33.045630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df858c-b0d2-40da-80e9-bcc60101f23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:33.065819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-30df858c-b0d2-40da-80e9-bcc60101f23e None None] MFA Rules not processed for user `5c3a493331c9414e9c9493d90852b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:33.067037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-30df858c-b0d2-40da-80e9-bcc60101f23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:33.075407 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1127/2236] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:34.978145 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb553df-d268-4fd2-9024-5804ada3df25 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:34.979450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb553df-d268-4fd2-9024-5804ada3df25 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:34.979752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb553df-d268-4fd2-9024-5804ada3df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:35.005953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-beb553df-d268-4fd2-9024-5804ada3df25 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:35.007222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-beb553df-d268-4fd2-9024-5804ada3df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:35.016739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1110/2237] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:35.032847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df858c-b0d2-40da-80e9-bcc60101f23e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:35.046589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df858c-b0d2-40da-80e9-bcc60101f23e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:35.053681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0980331-fd3f-44fc-8549-e60b9ed58990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:35.054320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0980331-fd3f-44fc-8549-e60b9ed58990 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:35.054608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0980331-fd3f-44fc-8549-e60b9ed58990 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:35.054887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0980331-fd3f-44fc-8549-e60b9ed58990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:35.070070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0980331-fd3f-44fc-8549-e60b9ed58990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:35.071685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0980331-fd3f-44fc-8549-e60b9ed58990 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:35.093269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1128/2238] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:38.591960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963041-2f60-4453-8053-bb6f78b48dc3 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:38.593085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963041-2f60-4453-8053-bb6f78b48dc3 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:38.593364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963041-2f60-4453-8053-bb6f78b48dc3 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:38.595176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1111/2239] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:51:38.631152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:38.631730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:38.632107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:38.654264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:38.655761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:38.758306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1129/2240] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:51:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:38.770040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963041-2f60-4453-8053-bb6f78b48dc3 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:38.772284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e1963041-2f60-4453-8053-bb6f78b48dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:38.792711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963041-2f60-4453-8053-bb6f78b48dc3 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:38.803969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:38.804586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:38.804861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:38.805166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:38.814917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:38.816871 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:38.830355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1112/2241] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:39.338746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:39.340769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:39.356180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586a7d6-4f8b-434b-9ed0-83834acdb1bb None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:39.363032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:39.363716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:39.364092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:39.364375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] PATH_INFO: `/v3/users/2897301aa593402b9c259dbbf9358dbf` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:39.365551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2897301aa593402b9c259dbbf9358dbf)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:39.367643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:39.443566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2897301aa593402b9c259dbbf9358dbf'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:39.444365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2897301aa593402b9c259dbbf9358dbf'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:39.455644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2897301aa593402b9c259dbbf9358dbf'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:39.475939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2897301aa593402b9c259dbbf9358dbf'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:39.476719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2897301aa593402b9c259dbbf9358dbf'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:39.507123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1130/2242] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:51:39 2022] DELETE /identity/v3/users/2897301aa593402b9c259dbbf9358dbf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:51:39.901849 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:39.914537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853ac9-d752-45be-b665-1407f978f833 service placement] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:39.996406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:39.997086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:39.997362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:39.997823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] PATH_INFO: `/v3/projects/9704ffeea8964271ab40a787df9bf0a7` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:39.998967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9704ffeea8964271ab40a787df9bf0a7)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:40.001960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:40.059046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9704ffeea8964271ab40a787df9bf0a7', 'request_id': 'req-0cfa797a-20ff-4995-ade4-93cdf8476ad0'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.077451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9704ffeea8964271ab40a787df9bf0a7', 'request_id': 'req-0cfa797a-20ff-4995-ade4-93cdf8476ad0'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.084072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9704ffeea8964271ab40a787df9bf0a7', 'request_id': 'req-0cfa797a-20ff-4995-ade4-93cdf8476ad0'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.120688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] The token cache is being invalidate because project 9704ffeea8964271ab40a787df9bf0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:51:40.121092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.121999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-0cfa797a-20ff-4995-ade4-93cdf8476ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.124223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1113/2243] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:51:39 2022] DELETE /identity/v3/projects/9704ffeea8964271ab40a787df9bf0a7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:51:40.128463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:40.130802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:40.152010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc59ab-b1ec-48fe-9e66-6ef453f68406 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:40.210023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:40.241989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:40.242379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:40.242530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:40.281859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:40.283089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:40.296104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:40.298911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:40.300734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:40.301169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] PATH_INFO: `/v3/users/d6e0b20e020b4a5d8954fe834e378069` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:40.303597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e0b20e020b4a5d8954fe834e378069)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:40.306339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:40.355012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:40.368427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e0b20e020b4a5d8954fe834e378069'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.369115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e0b20e020b4a5d8954fe834e378069'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.373207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1114/2244] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:40.376576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e0b20e020b4a5d8954fe834e378069'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.385139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e0b20e020b4a5d8954fe834e378069'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.385851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e0b20e020b4a5d8954fe834e378069'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.388995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:40.390729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:40.408150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1131/2245] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:51:40 2022] DELETE /identity/v3/users/d6e0b20e020b4a5d8954fe834e378069 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:51:40.482893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4100f1-430f-416d-8973-68522498eb02 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:40.557054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0c05a-0fb6-419d-b4ce-777bb1df3dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:40.557753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0c05a-0fb6-419d-b4ce-777bb1df3dfe service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:40.558102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0c05a-0fb6-419d-b4ce-777bb1df3dfe service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:40.558447 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0c05a-0fb6-419d-b4ce-777bb1df3dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:40.560459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bef0c05a-0fb6-419d-b4ce-777bb1df3dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:40.613681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:40.615249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:40.660021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0c05a-0fb6-419d-b4ce-777bb1df3dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:40.663892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0c05a-0fb6-419d-b4ce-777bb1df3dfe service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:40.684538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1115/2246] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:40.721102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72486a89-d085-4674-8981-54e4590f8f56 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:40.727641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:40.728188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:40.728484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:40.728818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] PATH_INFO: `/v3/projects/6465498d450a4c058e2a1e37b56580c7` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:40.730109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6465498d450a4c058e2a1e37b56580c7)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:40.732118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:40.782482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6465498d450a4c058e2a1e37b56580c7', 'request_id': 'req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.783612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:40.790095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6465498d450a4c058e2a1e37b56580c7', 'request_id': 'req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.797196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6465498d450a4c058e2a1e37b56580c7', 'request_id': 'req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.812479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] The token cache is being invalidate because project 6465498d450a4c058e2a1e37b56580c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:51:40.812829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.813593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-749264d5-241d-4cab-acf3-3d2fc2fbeb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:40.815140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1132/2247] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:51:40 2022] DELETE /identity/v3/projects/6465498d450a4c058e2a1e37b56580c7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:51:40.821485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909beb-fb47-4668-9311-ede14108e0ac None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:40.821843 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909beb-fb47-4668-9311-ede14108e0ac None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:40.822121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909beb-fb47-4668-9311-ede14108e0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:40.845531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7c909beb-fb47-4668-9311-ede14108e0ac None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:40.846756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7c909beb-fb47-4668-9311-ede14108e0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:40.878805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:40.916379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1116/2248] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:51:40.984616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fdfd-efde-494a-baaa-8bfe2bca3d56 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:40.984948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fdfd-efde-494a-baaa-8bfe2bca3d56 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:40.985379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994fdfd-efde-494a-baaa-8bfe2bca3d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.007827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0994fdfd-efde-494a-baaa-8bfe2bca3d56 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:41.009118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0994fdfd-efde-494a-baaa-8bfe2bca3d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:41.017736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1133/2249] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:41.022218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c909beb-fb47-4668-9311-ede14108e0ac None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:41.032543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c909beb-fb47-4668-9311-ede14108e0ac None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:41.037291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:41.037900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.038181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.038458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.039104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:51:41.039412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:41.041105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:41.054456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1117/2250] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:51:41.059384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fdfd-efde-494a-baaa-8bfe2bca3d56 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:41.068945 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994fdfd-efde-494a-baaa-8bfe2bca3d56 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:41.074337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:41.074943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.075227 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.075504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.076154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:41.079041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:41.112318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1134/2251] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:51:41 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:51:41.115992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:41.131731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962db2a-76a8-46f0-b238-0ba745711cbb admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:41.208456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:41.209103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.209381 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.209649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.210288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:41.212259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:41.239076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1118/2252] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:51:41 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:51:41.242160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:41.253505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362757-5606-4b39-9956-e5268db749b1 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:41.258574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:41.259156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.259439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.259742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.260388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:41.262090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:41.273117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1135/2253] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:51:41.277299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:41.288221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc1169-bd1d-4191-a0b9-1e41f397091a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:41.294286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e3a4-b220-41fd-9588-f845d773aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:41.294864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e3a4-b220-41fd-9588-f845d773aa31 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.295148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e3a4-b220-41fd-9588-f845d773aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.295425 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e3a4-b220-41fd-9588-f845d773aa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.296078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26e3a4-b220-41fd-9588-f845d773aa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:41.298059 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26e3a4-b220-41fd-9588-f845d773aa31 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:41.309446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1119/2254] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:51:41.314001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:41.324823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49777c6-2b79-4614-9dcb-811b09ac431e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:41.330497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:41.331149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.331425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.331696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] PATH_INFO: `/v3/projects/eac31b48b0784c72b1d32568bcda90d4/users/8569fd5535cb402c97e06fa93440b018/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.348757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac31b48b0784c72b1d32568bcda90d4, user_id=8569fd5535cb402c97e06fa93440b018, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:41.353240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:41.371929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1136/2255] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:51:41 2022] PUT /identity/v3/projects/eac31b48b0784c72b1d32568bcda90d4/users/8569fd5535cb402c97e06fa93440b018/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:51:41.385461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f560-a697-4d23-b053-62d490c7f4e9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.385836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f560-a697-4d23-b053-62d490c7f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.386200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9f560-a697-4d23-b053-62d490c7f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.416858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e3c9f560-a697-4d23-b053-62d490c7f4e9 None None] MFA Rules not processed for user `8569fd5535cb402c97e06fa93440b018`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:41.418124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e3c9f560-a697-4d23-b053-62d490c7f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:41.488668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1120/2256] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:41.501047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:41.503202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:41.565397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7066007-a062-41e5-8297-726955c5e6d4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:41.569513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:41.570505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:41.571006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:41.571411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:41.581841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:41.583307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:41.593565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1137/2257] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:46.532994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccdb0f-2049-47c3-b062-7e846680ba29 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:46.533492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccdb0f-2049-47c3-b062-7e846680ba29 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:46.533622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccdb0f-2049-47c3-b062-7e846680ba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:46.554657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b0ccdb0f-2049-47c3-b062-7e846680ba29 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:46.555893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b0ccdb0f-2049-47c3-b062-7e846680ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:46.577090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:46.620348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1121/2258] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:46.636115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:46.637688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:46.717464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccdb0f-2049-47c3-b062-7e846680ba29 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:46.728250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccdb0f-2049-47c3-b062-7e846680ba29 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:46.733780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:46.734429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:46.734710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:46.734989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] PATH_INFO: `/v3/users/8569fd5535cb402c97e06fa93440b018` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:46.736508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8569fd5535cb402c97e06fa93440b018)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:46.737576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422f4af-6adc-4ded-9949-df323d72c4c1 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:46.738984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:46.745009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3e00-e3b4-41bc-a45f-511e30bbf244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:46.745442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3e00-e3b4-41bc-a45f-511e30bbf244 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:46.746542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3e00-e3b4-41bc-a45f-511e30bbf244 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:46.746542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3e00-e3b4-41bc-a45f-511e30bbf244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:46.757028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a3e00-e3b4-41bc-a45f-511e30bbf244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:46.758713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a3e00-e3b4-41bc-a45f-511e30bbf244 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:46.780546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1138/2259] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:46.810064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8569fd5535cb402c97e06fa93440b018'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:46.811607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8569fd5535cb402c97e06fa93440b018'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:46.823698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8569fd5535cb402c97e06fa93440b018'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:46.825094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8569fd5535cb402c97e06fa93440b018'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:46.839806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-ef91335b-5dfb-4b2d-af75-e8c1214e6e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8569fd5535cb402c97e06fa93440b018'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:46.857217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1122/2260] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:51:46 2022] DELETE /identity/v3/users/8569fd5535cb402c97e06fa93440b018 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:51:46.862340 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:46.862657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:46.862925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:46.871677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:46.871991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:46.872628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:46.873075 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:46.885449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:46.887374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:46.894613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] MFA Rules not processed for user `44a51adff4c546da9c7f476e58e2fc88`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:51:46.896060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:46.957105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1123/2261] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:46.959701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1139/2262] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:51:46.970040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:46.971661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:47.021623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:47.034692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f8ab0-83c1-4b86-bb15-db78f7600b1d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:47.039714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e564f2a-6aaf-4072-a879-045ebd98dbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:47.040417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e564f2a-6aaf-4072-a879-045ebd98dbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:47.040703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e564f2a-6aaf-4072-a879-045ebd98dbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:47.041009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e564f2a-6aaf-4072-a879-045ebd98dbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:47.050462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e564f2a-6aaf-4072-a879-045ebd98dbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:47.051920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e564f2a-6aaf-4072-a879-045ebd98dbc8 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:47.062179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1124/2263] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:51:47.489703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:51:47.491591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:51:47.510849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5804d6-3050-4ddd-b1dd-8dbc6ea43077 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:51:47.519016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:51:47.519825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:51:47.520170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:51:47.520525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] PATH_INFO: `/v3/projects/eac31b48b0784c72b1d32568bcda90d4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:51:47.521801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac31b48b0784c72b1d32568bcda90d4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:51:47.523810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:51:47.584990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac31b48b0784c72b1d32568bcda90d4', 'request_id': 'req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:47.592204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac31b48b0784c72b1d32568bcda90d4', 'request_id': 'req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:47.599332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac31b48b0784c72b1d32568bcda90d4', 'request_id': 'req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:47.614899 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] The token cache is being invalidate because project eac31b48b0784c72b1d32568bcda90d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:51:47.615275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:47.615998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:51:47.617706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1140/2264] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:51:47 2022] DELETE /identity/v3/projects/eac31b48b0784c72b1d32568bcda90d4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:51:57.057936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=6 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:51:57.612129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:09.690125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baebc1f-3a17-4bfd-acf8-b6ebfe078228 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:09.690857 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baebc1f-3a17-4bfd-acf8-b6ebfe078228 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:09.691132 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baebc1f-3a17-4bfd-acf8-b6ebfe078228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:09.725224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0baebc1f-3a17-4bfd-acf8-b6ebfe078228 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:09.727459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0baebc1f-3a17-4bfd-acf8-b6ebfe078228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:09.811554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1125/2265] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:52:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:09.864187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:09.867016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:09.974837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a52c44-c1bc-4c19-9e1c-c42e3f5c7931 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:09.984393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c309d-9198-4da4-b549-3f3b478caed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:09.986129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c309d-9198-4da4-b549-3f3b478caed6 service swift] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:09.986946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c309d-9198-4da4-b549-3f3b478caed6 service swift] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:09.987225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c309d-9198-4da4-b549-3f3b478caed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:09.996807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c309d-9198-4da4-b549-3f3b478caed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:09.998438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c309d-9198-4da4-b549-3f3b478caed6 service swift] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:10.008149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1141/2266] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:52:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:52:11.053691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29aa49-6e6c-44e3-be97-0ff01055ba4b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:11.054369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29aa49-6e6c-44e3-be97-0ff01055ba4b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:11.054505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29aa49-6e6c-44e3-be97-0ff01055ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:11.087014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ec29aa49-6e6c-44e3-be97-0ff01055ba4b None None] MFA Rules not processed for user `a757a294c21348169ad3364176c020f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:11.088848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ec29aa49-6e6c-44e3-be97-0ff01055ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:11.183306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1126/2267] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:52:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:52:20.004803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=32 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:21.168783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=50 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:27.365455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844eb3-6806-4d51-98c2-2ad71c3d9bd5 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:27.365985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844eb3-6806-4d51-98c2-2ad71c3d9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:27.367310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844eb3-6806-4d51-98c2-2ad71c3d9bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:27.390307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c9844eb3-6806-4d51-98c2-2ad71c3d9bd5 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:27.391804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c9844eb3-6806-4d51-98c2-2ad71c3d9bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:27.402582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1142/2268] 10.222.0.13 () {58 vars in 967 bytes} [Sat Sep 3 03:52:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:27.415734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29aa49-6e6c-44e3-be97-0ff01055ba4b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:27.432226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29aa49-6e6c-44e3-be97-0ff01055ba4b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:27.438050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:27.438989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:27.439274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:27.439543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:27.450671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:27.452696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:27.462142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1127/2269] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:52:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:52:28.854116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:28.854585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:28.854901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:28.875885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:28.877137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:28.942545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1143/2270] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:28.974660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:28.976098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:29.068242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20e5bc-b318-4387-9751-a5ec1aee8949 service swift] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:29.073833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:29.074444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:29.074753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:29.075017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:29.083882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:29.085540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:29.096065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1128/2271] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:52:29.473546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:29.475356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:29.489092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da53d-5fbb-4692-868e-54ac89333f90 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:29.494200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:29.494838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:29.495116 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:29.495391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] PATH_INFO: `/v3/users/5c3a493331c9414e9c9493d90852b8dc` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:29.496642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3a493331c9414e9c9493d90852b8dc)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:29.498638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:29.565186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3a493331c9414e9c9493d90852b8dc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.565978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3a493331c9414e9c9493d90852b8dc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.572679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3a493331c9414e9c9493d90852b8dc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.581246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3a493331c9414e9c9493d90852b8dc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.581902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6d22911-1e53-43a6-8217-e6313f4d21e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3a493331c9414e9c9493d90852b8dc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.600055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1144/2272] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:52:29 2022] DELETE /identity/v3/users/5c3a493331c9414e9c9493d90852b8dc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:52:29.778679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:29.791716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9756-9569-4d40-968d-5581835c55ea service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:29.857157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:29.857722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:29.858001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:29.858276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] PATH_INFO: `/v3/projects/0f1130b2e2244aaeb2ed29888a5863f2` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:29.859392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1130b2e2244aaeb2ed29888a5863f2)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:29.861608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:29.913388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1130b2e2244aaeb2ed29888a5863f2', 'request_id': 'req-42a52c33-a908-4bd1-b02d-586d7452048a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.922347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1130b2e2244aaeb2ed29888a5863f2', 'request_id': 'req-42a52c33-a908-4bd1-b02d-586d7452048a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.928759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1130b2e2244aaeb2ed29888a5863f2', 'request_id': 'req-42a52c33-a908-4bd1-b02d-586d7452048a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.941077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] The token cache is being invalidate because project 0f1130b2e2244aaeb2ed29888a5863f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:52:29.941404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.942128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-42a52c33-a908-4bd1-b02d-586d7452048a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:52:29.943707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1129/2273] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:52:29 2022] DELETE /identity/v3/projects/0f1130b2e2244aaeb2ed29888a5863f2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:52:29.948642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4f3d-4391-4309-8f68-2fbe3ca3d078 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:29.949106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4f3d-4391-4309-8f68-2fbe3ca3d078 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:29.949215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4f3d-4391-4309-8f68-2fbe3ca3d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:29.970167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-4bea4f3d-4391-4309-8f68-2fbe3ca3d078 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:29.971361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-4bea4f3d-4391-4309-8f68-2fbe3ca3d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:30.032426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1145/2274] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:30.100105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55f93-4c22-4f56-baf6-596bd5391a9d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.100683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55f93-4c22-4f56-baf6-596bd5391a9d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.100683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e55f93-4c22-4f56-baf6-596bd5391a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.109151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:30.128767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-77e55f93-4c22-4f56-baf6-596bd5391a9d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:30.130020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-77e55f93-4c22-4f56-baf6-596bd5391a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:30.138494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1130/2275] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:30.143186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4f3d-4391-4309-8f68-2fbe3ca3d078 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:30.153607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4f3d-4391-4309-8f68-2fbe3ca3d078 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:30.158942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:30.159573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.159854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.160126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.160812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:52:30.161168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:30.162793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:30.164554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:30.185909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1146/2276] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:52:30.190185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55f93-4c22-4f56-baf6-596bd5391a9d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:30.209259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e55f93-4c22-4f56-baf6-596bd5391a9d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:30.214772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:30.215388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.215663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.215953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.216601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:30.218591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:30.248105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1131/2277] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:52:30 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:52:30.252656 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:30.263239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa187fbd-1074-49f0-89fd-2b0d6acf1637 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:30.324472 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:30.325433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.325816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.326144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.326997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:30.329689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:30.353699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1147/2278] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:52:30 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:52:30.357903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:30.368717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497b1c0-6a23-4fb3-8d3f-8a583e38c2ad admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:30.374141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:30.374764 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.375049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.375324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.376353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:30.378043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:30.388112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1132/2279] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:52:30.392396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:30.403108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef574-6918-48a3-8be7-093a58353ea2 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:30.409043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023243ae-21fb-47b9-889c-eba3240c55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:30.409648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023243ae-21fb-47b9-889c-eba3240c55d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.409937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023243ae-21fb-47b9-889c-eba3240c55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.410211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023243ae-21fb-47b9-889c-eba3240c55d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.410842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023243ae-21fb-47b9-889c-eba3240c55d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:30.412443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023243ae-21fb-47b9-889c-eba3240c55d5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:30.423996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1148/2280] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:52:30.428193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:30.438546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f7061-3420-4ad6-a880-847b9af1ff01 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:30.443879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:30.444536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.444813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.445129 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] PATH_INFO: `/v3/projects/793239c33d6d4a89a682b04c8a7a19d8/users/57f870fc9b214f099620ae722f4f2486/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.460232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] RBAC: Authorizing `identity:create_grant(project_id=793239c33d6d4a89a682b04c8a7a19d8, user_id=57f870fc9b214f099620ae722f4f2486, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:30.462937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:30.478672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1133/2281] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:52:30 2022] PUT /identity/v3/projects/793239c33d6d4a89a682b04c8a7a19d8/users/57f870fc9b214f099620ae722f4f2486/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:52:30.489217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.489505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.489783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.521196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] MFA Rules not processed for user `57f870fc9b214f099620ae722f4f2486`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:30.522484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:30.591511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1149/2282] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:52:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:30.604781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:30.606540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:30.695646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d486-ec39-4b1b-a9a3-17d7533d696b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:30.700191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605af04-5b31-4ae1-9e4c-86837d3b230e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22a017e6b1d64044b4f5e3fb67cfd67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:30.700824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605af04-5b31-4ae1-9e4c-86837d3b230e service glance] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:30.701126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605af04-5b31-4ae1-9e4c-86837d3b230e service glance] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:30.701386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605af04-5b31-4ae1-9e4c-86837d3b230e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:30.711020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605af04-5b31-4ae1-9e4c-86837d3b230e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:30.712522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605af04-5b31-4ae1-9e4c-86837d3b230e service glance] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:30.721756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1134/2283] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:52:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:52:31.094249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:31.097488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:31.204802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:31.211728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f36d-a8fd-492f-9f9b-931d3ab74c43 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:31.218430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:31.219695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:31.221941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:31.222838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:31.226949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:31.245957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:31.248291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:31.263313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1150/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:52:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:52:33.175338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dcc21-a199-4877-937f-bdfd6e54c88f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:33.175805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dcc21-a199-4877-937f-bdfd6e54c88f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:33.175915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dcc21-a199-4877-937f-bdfd6e54c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:33.198136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-750dcc21-a199-4877-937f-bdfd6e54c88f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:33.199427 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-750dcc21-a199-4877-937f-bdfd6e54c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:33.266138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1135/2285] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:33.281679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:33.283298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:33.369789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2839bbc-08b7-473c-b595-07c8c724a8a9 service placement] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:33.380107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:33.380744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:33.381058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:33.381452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:33.395138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:33.397792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:33.410651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1151/2286] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:52:37.260633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c70277-aec9-4216-b03c-9e35147f4b65 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:37.261251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c70277-aec9-4216-b03c-9e35147f4b65 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:37.261251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c70277-aec9-4216-b03c-9e35147f4b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:37.281780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b1c70277-aec9-4216-b03c-9e35147f4b65 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:37.283036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b1c70277-aec9-4216-b03c-9e35147f4b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:37.293047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1136/2287] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:37.308560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:37.310206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:37.325957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ecdaf-4e33-4058-859f-4a5aa726c095 service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:37.332701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:37.333391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:37.333653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:37.333940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:37.343366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:37.344988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:37.355103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1152/2288] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:52:42.514552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0329ce0-644e-41ef-bae3-6c3026014a4c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:42.515049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0329ce0-644e-41ef-bae3-6c3026014a4c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:42.515224 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0329ce0-644e-41ef-bae3-6c3026014a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:42.535400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b0329ce0-644e-41ef-bae3-6c3026014a4c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:42.536672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b0329ce0-644e-41ef-bae3-6c3026014a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:42.544469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1137/2289] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:42.559738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:42.571351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7f1f-2cba-43d4-bdc5-6bb6703936bd service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:42.577125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:42.577736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:42.578017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:42.578287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:42.588054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:42.589670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:42.599958 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1153/2290] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:52:48.832690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ddbc-4b79-4dc1-95b0-0556107926d8 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:48.833237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ddbc-4b79-4dc1-95b0-0556107926d8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:48.833237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ddbc-4b79-4dc1-95b0-0556107926d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:48.853829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d8e2ddbc-4b79-4dc1-95b0-0556107926d8 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:48.855057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d8e2ddbc-4b79-4dc1-95b0-0556107926d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:48.864651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1138/2291] 10.222.0.42 () {58 vars in 1016 bytes} [Sat Sep 3 03:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:52:48.886320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:48.898654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321654c0-e9cc-4653-b593-e70565797980 service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:48.906596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:48.907431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:48.907717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:48.907983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:48.919628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:48.921229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:48.933146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1154/2292] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:52:50.607619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0797-6fee-413b-88ac-0c56f0e97422 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:50.608113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0797-6fee-413b-88ac-0c56f0e97422 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:50.608213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf0797-6fee-413b-88ac-0c56f0e97422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:50.616471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:52:50.631119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2dbf0797-6fee-413b-88ac-0c56f0e97422 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:52:50.632382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2dbf0797-6fee-413b-88ac-0c56f0e97422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:50.694385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1139/2293] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:52:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:52:50.707592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:52:50.709149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:52:50.793192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ffeac-62d4-48a6-b499-852131c3c183 service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:52:50.799106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b227-ea08-40e0-b1e8-e68536245057 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:52:50.799688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b227-ea08-40e0-b1e8-e68536245057 service swift] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:52:50.800001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b227-ea08-40e0-b1e8-e68536245057 service swift] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:52:50.800276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b227-ea08-40e0-b1e8-e68536245057 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:52:50.809202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768b227-ea08-40e0-b1e8-e68536245057 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:52:50.810802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768b227-ea08-40e0-b1e8-e68536245057 service swift] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:52:50.819109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1155/2294] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:52:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:53:00.686866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=24 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:00.815825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=88 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:05.711804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf0797-6fee-413b-88ac-0c56f0e97422 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:05.724295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf0797-6fee-413b-88ac-0c56f0e97422 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:05.729887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:05.730515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:05.730770 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:05.731060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] PATH_INFO: `/v3/users/57f870fc9b214f099620ae722f4f2486` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:05.732257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f870fc9b214f099620ae722f4f2486)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:05.734664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:05.786765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f870fc9b214f099620ae722f4f2486'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:05.787516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f870fc9b214f099620ae722f4f2486'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:05.796433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f870fc9b214f099620ae722f4f2486'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:05.797161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f870fc9b214f099620ae722f4f2486'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:05.810573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f870fc9b214f099620ae722f4f2486'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:05.823589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1140/2295] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:53:05 2022] DELETE /identity/v3/users/57f870fc9b214f099620ae722f4f2486 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:05.828509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:05.829044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:05.829140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:05.848519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:05.849853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:05.910275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1156/2296] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:05.920735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:05.922352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:06.002545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032eb9-3a06-4b62-aad6-b26f16955537 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.007054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17ec1e-e778-47c4-a287-d2ce172e6220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.007757 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17ec1e-e778-47c4-a287-d2ce172e6220 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.008070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17ec1e-e778-47c4-a287-d2ce172e6220 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.008347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17ec1e-e778-47c4-a287-d2ce172e6220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.020336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17ec1e-e778-47c4-a287-d2ce172e6220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.021919 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17ec1e-e778-47c4-a287-d2ce172e6220 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.032967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1141/2297] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:53:06.318311 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.320338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:06.337903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18132075-ea50-4e76-a85c-5fdda01b447c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.345019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.345671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.345911 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.346182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] PATH_INFO: `/v3/projects/793239c33d6d4a89a682b04c8a7a19d8` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.347298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] RBAC: Authorizing `identity:delete_project(project_id=793239c33d6d4a89a682b04c8a7a19d8)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.349253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.397917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793239c33d6d4a89a682b04c8a7a19d8', 'request_id': 'req-b7b1b10b-11d9-4476-b961-9d4d35df285c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:06.404003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793239c33d6d4a89a682b04c8a7a19d8', 'request_id': 'req-b7b1b10b-11d9-4476-b961-9d4d35df285c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:06.409558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793239c33d6d4a89a682b04c8a7a19d8', 'request_id': 'req-b7b1b10b-11d9-4476-b961-9d4d35df285c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:06.422931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] The token cache is being invalidate because project 793239c33d6d4a89a682b04c8a7a19d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:53:06.423308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:06.423977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b7b1b10b-11d9-4476-b961-9d4d35df285c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:06.425807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1157/2298] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:53:06 2022] DELETE /identity/v3/projects/793239c33d6d4a89a682b04c8a7a19d8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:06.430658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb8e1f-f0e4-4d20-afd1-6f9c3f4816ac None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.430943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb8e1f-f0e4-4d20-afd1-6f9c3f4816ac None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.431218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb8e1f-f0e4-4d20-afd1-6f9c3f4816ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.451568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-9dfb8e1f-f0e4-4d20-afd1-6f9c3f4816ac None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:06.452815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9dfb8e1f-f0e4-4d20-afd1-6f9c3f4816ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:06.518876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1142/2299] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:06.528599 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7189-1aa0-4b85-a31c-c59ba1aa9714 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.528893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7189-1aa0-4b85-a31c-c59ba1aa9714 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.529220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7189-1aa0-4b85-a31c-c59ba1aa9714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.550818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-74fa7189-1aa0-4b85-a31c-c59ba1aa9714 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:06.552182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-74fa7189-1aa0-4b85-a31c-c59ba1aa9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:06.561973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1158/2300] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:06.565931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb8e1f-f0e4-4d20-afd1-6f9c3f4816ac None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.576460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb8e1f-f0e4-4d20-afd1-6f9c3f4816ac None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.582205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.582949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.583331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.583705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.584445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:53:06.585127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.586877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.600572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1143/2301] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:53:06.605580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7189-1aa0-4b85-a31c-c59ba1aa9714 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.618465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7189-1aa0-4b85-a31c-c59ba1aa9714 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.623906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.624535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.624818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.625130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.625784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.628045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.661199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1159/2302] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:53:06 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:53:06.665438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.671305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:06.679140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cd214-7b5f-4747-af82-948192493506 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.743896 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbda051-4a59-4834-8117-444e0d2cd995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.745494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda051-4a59-4834-8117-444e0d2cd995 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.745870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda051-4a59-4834-8117-444e0d2cd995 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.746415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbda051-4a59-4834-8117-444e0d2cd995 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.747435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda051-4a59-4834-8117-444e0d2cd995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.749778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbda051-4a59-4834-8117-444e0d2cd995 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.775493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1144/2303] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:53:06 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:53:06.780803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.794102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba989a54-3b97-4529-b1f7-3bcc67ad02c4 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.818123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.818781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.821108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.822050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.823069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.825219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.827146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e21c9c-6a37-445e-ad20-8eba0b69c85a None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.827146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e21c9c-6a37-445e-ad20-8eba0b69c85a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.827348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e21c9c-6a37-445e-ad20-8eba0b69c85a None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.830271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1145/2304] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:53:06.836884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.837199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.837631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.863779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1160/2305] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:53:06.866885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.883495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73251c2-4b13-4882-b011-d58f281fd6ca admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.890264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:06.891593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:06.895650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.896308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.896616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.896860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.899354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.900950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.924937 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1161/2306] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:53:06.927532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.945735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3641d0-bb77-433a-92ec-fa3c9b7e11ed admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:06.954101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dfad2-b243-4cad-bd25-f28ae4747aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:06.955303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dfad2-b243-4cad-bd25-f28ae4747aad admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:06.956101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dfad2-b243-4cad-bd25-f28ae4747aad admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:06.957182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dfad2-b243-4cad-bd25-f28ae4747aad admin admin] PATH_INFO: `/v3/projects/767664f27f2d420a85ab19c717333d68/users/55c074faa0914a009560b67c911fb43a/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:06.974583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1146/2307] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:06.980708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dfad2-b243-4cad-bd25-f28ae4747aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=767664f27f2d420a85ab19c717333d68, user_id=55c074faa0914a009560b67c911fb43a, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:06.984191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dfad2-b243-4cad-bd25-f28ae4747aad admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:06.986268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:06.987709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:07.000827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1162/2308] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:53:06 2022] PUT /identity/v3/projects/767664f27f2d420a85ab19c717333d68/users/55c074faa0914a009560b67c911fb43a/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:53:07.011385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.011681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.011961 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.031852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:07.043540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] MFA Rules not processed for user `55c074faa0914a009560b67c911fb43a`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:07.045217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:07.059576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315b384-c7d7-400d-a966-e62dc3dcca19 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:07.098544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:07.111040 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520073-6dd9-46a4-a8a1-6968877f7d86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22a017e6b1d64044b4f5e3fb67cfd67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:07.111746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520073-6dd9-46a4-a8a1-6968877f7d86 service glance] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.112021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520073-6dd9-46a4-a8a1-6968877f7d86 service glance] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.112290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520073-6dd9-46a4-a8a1-6968877f7d86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.112476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1163/2309] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:07.124256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:07.125707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:07.189948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873d0ed-f377-4cf3-a2ec-eb733c43e04b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:07.190196 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520073-6dd9-46a4-a8a1-6968877f7d86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:07.191762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520073-6dd9-46a4-a8a1-6968877f7d86 service glance] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:07.193719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573595fb-7984-47db-9adf-d769d1e72bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:07.194450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573595fb-7984-47db-9adf-d769d1e72bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.194924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573595fb-7984-47db-9adf-d769d1e72bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.195290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573595fb-7984-47db-9adf-d769d1e72bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.203206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1147/2310] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:53:07.203628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573595fb-7984-47db-9adf-d769d1e72bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:07.205189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573595fb-7984-47db-9adf-d769d1e72bd0 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:07.214713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1164/2311] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:53:07.274686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5dbd1-ca87-4a44-ab0a-9b58dd21dd45 None None] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.275119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5dbd1-ca87-4a44-ab0a-9b58dd21dd45 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.275408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5dbd1-ca87-4a44-ab0a-9b58dd21dd45 None None] PATH_INFO: `/` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.276741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1148/2312] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:53:07.281905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a04c1-6b4d-4e0c-b076-a3081163f4a4 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.282353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a04c1-6b4d-4e0c-b076-a3081163f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.282453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a04c1-6b4d-4e0c-b076-a3081163f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.304951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e44a04c1-6b4d-4e0c-b076-a3081163f4a4 None None] MFA Rules not processed for user `c1a7ee9f78da46e4abe27eadb2d17b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:07.306218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e44a04c1-6b4d-4e0c-b076-a3081163f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:07.360018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1165/2313] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:53:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:07.373902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5dbd1-ca87-4a44-ab0a-9b58dd21dd45 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:07.375641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-97a5dbd1-ca87-4a44-ab0a-9b58dd21dd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:07.391731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5dbd1-ca87-4a44-ab0a-9b58dd21dd45 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:07.395441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bfdc4-bbc6-442a-8d21-683d8bec4ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:07.396105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bfdc4-bbc6-442a-8d21-683d8bec4ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.396389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bfdc4-bbc6-442a-8d21-683d8bec4ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.396659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bfdc4-bbc6-442a-8d21-683d8bec4ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.404769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bfdc4-bbc6-442a-8d21-683d8bec4ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:07.406280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bfdc4-bbc6-442a-8d21-683d8bec4ac4 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:07.414466 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1149/2314] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:53:07.505974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3361e7-de34-4e6e-8d5d-659e6c22b645 None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.506432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3361e7-de34-4e6e-8d5d-659e6c22b645 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.506811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3361e7-de34-4e6e-8d5d-659e6c22b645 None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.508683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1166/2315] 10.222.0.13 () {54 vars in 921 bytes} [Sat Sep 3 03:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 03:53:07.514394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418df9f-ec46-4d9b-ac56-fbfbfa8a797c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.514852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418df9f-ec46-4d9b-ac56-fbfbfa8a797c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.515467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418df9f-ec46-4d9b-ac56-fbfbfa8a797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.544852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8418df9f-ec46-4d9b-ac56-fbfbfa8a797c None None] MFA Rules not processed for user `b74a8d0579ba402c8f64fa7a6bb24658`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:07.546123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8418df9f-ec46-4d9b-ac56-fbfbfa8a797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:07.557179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1150/2316] 10.222.0.13 () {58 vars in 1018 bytes} [Sat Sep 3 03:53:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:53:07.570131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3361e7-de34-4e6e-8d5d-659e6c22b645 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:07.593120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3361e7-de34-4e6e-8d5d-659e6c22b645 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:07.597118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:07.597734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:07.598017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:07.598289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:07.610143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:07.611843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:07.624869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1167/2317] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:53:10.112498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9369-3d59-4ab1-a9ec-ea67a0f9ff3d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:10.112997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9369-3d59-4ab1-a9ec-ea67a0f9ff3d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:10.113150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9369-3d59-4ab1-a9ec-ea67a0f9ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:10.133444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f55d9369-3d59-4ab1-a9ec-ea67a0f9ff3d None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:10.134935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f55d9369-3d59-4ab1-a9ec-ea67a0f9ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:10.204131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1151/2318] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:53:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:10.231994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:10.234051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:10.281389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:10.314513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0a5d2-dcc5-45b7-999d-8afb09bc8b38 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:10.320345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ac68d-c42e-41ef-af20-c690dc82fcd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:10.320935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac68d-c42e-41ef-af20-c690dc82fcd0 service swift] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:10.321231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac68d-c42e-41ef-af20-c690dc82fcd0 service swift] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:10.321617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac68d-c42e-41ef-af20-c690dc82fcd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:10.332863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ac68d-c42e-41ef-af20-c690dc82fcd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:10.335637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ac68d-c42e-41ef-af20-c690dc82fcd0 service swift] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:10.348983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1168/2319] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:53:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:53:18.043480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9369-3d59-4ab1-a9ec-ea67a0f9ff3d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:18.141532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9369-3d59-4ab1-a9ec-ea67a0f9ff3d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:18.146322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:18.147093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:18.147614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:18.147853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] PATH_INFO: `/v3/users/55c074faa0914a009560b67c911fb43a` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:18.149449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c074faa0914a009560b67c911fb43a)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:18.151655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:18.161860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:18.244961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c074faa0914a009560b67c911fb43a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:18.247985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c074faa0914a009560b67c911fb43a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:18.255923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c074faa0914a009560b67c911fb43a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:18.256579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c074faa0914a009560b67c911fb43a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:18.269673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c074faa0914a009560b67c911fb43a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:18.282840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1152/2320] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:53:18 2022] DELETE /identity/v3/users/55c074faa0914a009560b67c911fb43a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:18.287521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:18.288087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:18.288192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:18.309302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:18.310545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:18.374210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1169/2321] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:18.384751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:18.386401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:18.451497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef0ec-79d4-4a20-a519-a30fee333c3a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:18.455360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:18.455981 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:18.456260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:18.456534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:18.467169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:18.468630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:18.479294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1153/2322] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:53:18.777982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:18.779481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:18.803544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd1de8-9839-4429-aa30-94964298af6e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:18.810365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:18.811026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:18.811442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:18.811719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] PATH_INFO: `/v3/projects/767664f27f2d420a85ab19c717333d68` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:18.812853 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=767664f27f2d420a85ab19c717333d68)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:18.815174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:18.995936 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767664f27f2d420a85ab19c717333d68', 'request_id': 'req-1a617e9c-357b-458b-bcd3-e124c614dc6f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:19.002996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767664f27f2d420a85ab19c717333d68', 'request_id': 'req-1a617e9c-357b-458b-bcd3-e124c614dc6f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:19.009710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767664f27f2d420a85ab19c717333d68', 'request_id': 'req-1a617e9c-357b-458b-bcd3-e124c614dc6f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:19.032224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] The token cache is being invalidate because project 767664f27f2d420a85ab19c717333d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:53:19.032519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:19.033287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:19.034832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1170/2323] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:53:18 2022] DELETE /identity/v3/projects/767664f27f2d420a85ab19c717333d68 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:24.578038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:24.579796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:24.594161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8171ef-4ce0-432e-93d3-b2dca6bf043b service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:24.650895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:24.651509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:24.651810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:24.652072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] PATH_INFO: `/v3/users/a757a294c21348169ad3364176c020f3` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:24.653232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a757a294c21348169ad3364176c020f3)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:24.655153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:24.692722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:24.707156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a757a294c21348169ad3364176c020f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:24.707821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a757a294c21348169ad3364176c020f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:24.716992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a757a294c21348169ad3364176c020f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:24.718015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a757a294c21348169ad3364176c020f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:24.731862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94b7ffa5-561f-4bc8-9a78-084a8f7dd1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a757a294c21348169ad3364176c020f3'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:24.743998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1154/2324] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:53:24 2022] DELETE /identity/v3/users/a757a294c21348169ad3364176c020f3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:24.955474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:24.958384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:24.974921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a617e9c-357b-458b-bcd3-e124c614dc6f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.026557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:25.037712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.038372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.038848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.039322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] PATH_INFO: `/v3/projects/c48f6ba8381c4bc7934b85d6cb019a02` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.040499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48f6ba8381c4bc7934b85d6cb019a02)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.042594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.093670 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48f6ba8381c4bc7934b85d6cb019a02', 'request_id': 'req-3e34317e-2817-4c7e-b0f1-093260b8682b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:25.104023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48f6ba8381c4bc7934b85d6cb019a02', 'request_id': 'req-3e34317e-2817-4c7e-b0f1-093260b8682b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:25.111187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48f6ba8381c4bc7934b85d6cb019a02', 'request_id': 'req-3e34317e-2817-4c7e-b0f1-093260b8682b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:25.127003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] The token cache is being invalidate because project c48f6ba8381c4bc7934b85d6cb019a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:53:25.127318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:25.127948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3e34317e-2817-4c7e-b0f1-093260b8682b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:53:25.129643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1171/2325] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:53:24 2022] DELETE /identity/v3/projects/c48f6ba8381c4bc7934b85d6cb019a02 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:25.136231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765639d8-8a9c-45d8-b1ca-34f93e8da143 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.136527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765639d8-8a9c-45d8-b1ca-34f93e8da143 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.136846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765639d8-8a9c-45d8-b1ca-34f93e8da143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.159445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-765639d8-8a9c-45d8-b1ca-34f93e8da143 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:25.160687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-765639d8-8a9c-45d8-b1ca-34f93e8da143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:25.224731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1155/2326] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:25.232946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c3c3-52af-4ad5-812d-886273444811 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.233233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c3c3-52af-4ad5-812d-886273444811 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.233899 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c3c3-52af-4ad5-812d-886273444811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.254792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-acd1c3c3-52af-4ad5-812d-886273444811 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:25.256361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-acd1c3c3-52af-4ad5-812d-886273444811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:25.265174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1172/2327] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:25.269544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765639d8-8a9c-45d8-b1ca-34f93e8da143 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:25.279538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765639d8-8a9c-45d8-b1ca-34f93e8da143 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.284171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.284773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.285078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.285345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.285987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:53:25.286284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.287899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.300170 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1156/2328] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:53:25.304561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c3c3-52af-4ad5-812d-886273444811 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:25.314233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c3c3-52af-4ad5-812d-886273444811 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.319080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.319744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.320056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.320322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.320989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.323224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.356230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1173/2329] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:53:25 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:53:25.357398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:25.367753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2cca7-3035-4a84-8459-b5423b5dae7f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.426654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.427267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.427542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.427810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.428449 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.430600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.454174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1157/2330] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:53:25 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:53:25.458401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:25.469340 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c64127-e00e-41f3-8224-8aa8334b4b34 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.474372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.474981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.475262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.475840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.476526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.478258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.488509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1174/2331] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:53:25.492732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:25.503416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43008bd-72c9-4425-a8e2-af65d2f50b3c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.508374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d81e9-bd85-4218-acc7-a74ab4a9146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.509017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d81e9-bd85-4218-acc7-a74ab4a9146b admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.509324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d81e9-bd85-4218-acc7-a74ab4a9146b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.509570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d81e9-bd85-4218-acc7-a74ab4a9146b admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.510305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d81e9-bd85-4218-acc7-a74ab4a9146b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.511928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d81e9-bd85-4218-acc7-a74ab4a9146b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.522727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1158/2332] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:53:25.527114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:25.537718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2bf9-8d41-4ad4-8961-a5048da8d81d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.543451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.544104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.544381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.544653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] PATH_INFO: `/v3/projects/57712f274aa3413c9b9a7334507f7a71/users/251c2d3d94364864bb31bf38fa5427cc/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.561214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57712f274aa3413c9b9a7334507f7a71, user_id=251c2d3d94364864bb31bf38fa5427cc, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.563883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.580815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1175/2333] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:53:25 2022] PUT /identity/v3/projects/57712f274aa3413c9b9a7334507f7a71/users/251c2d3d94364864bb31bf38fa5427cc/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:25.586102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879dde6-677d-4b90-a8b3-95503cf3dac1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.586643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879dde6-677d-4b90-a8b3-95503cf3dac1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.586643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879dde6-677d-4b90-a8b3-95503cf3dac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.607228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c879dde6-677d-4b90-a8b3-95503cf3dac1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:25.608480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c879dde6-677d-4b90-a8b3-95503cf3dac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:25.617704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:25.673363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1159/2334] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:25.683470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:25.685854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:25.748119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a5b93-e553-48e3-869f-a0a466c8390a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:25.752805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:25.753454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:25.753741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:25.754013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:25.767190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:25.769513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:25.787272 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1176/2335] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:53:30.244620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eaf3b-5038-4f72-a442-a6a5c2e358e7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:30.245303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eaf3b-5038-4f72-a442-a6a5c2e358e7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:30.245946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eaf3b-5038-4f72-a442-a6a5c2e358e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:30.295705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4a4eaf3b-5038-4f72-a442-a6a5c2e358e7 None None] MFA Rules not processed for user `251c2d3d94364864bb31bf38fa5427cc`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:30.297990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4a4eaf3b-5038-4f72-a442-a6a5c2e358e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:30.402730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1160/2336] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:30.406955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:30.418060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f2a0c-a61b-4283-9622-d625f87a0758 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:30.423418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:30.424090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:30.424376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:30.424651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:30.425320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:30.427241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:30.463914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:30.482697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eaf3b-5038-4f72-a442-a6a5c2e358e7 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:30.483174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1177/2337] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:53:30 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:53:30.496164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eaf3b-5038-4f72-a442-a6a5c2e358e7 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:30.568383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:30.569047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:30.569340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:30.569602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:30.570262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:30.572520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:30.596954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1161/2338] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:53:30 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:53:30.601148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:30.613068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89217d7f-ebc0-4f5b-905c-72509484c561 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:30.619407 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:30.620718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:30.621243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:30.621729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:30.622746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:30.624606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:30.641748 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1178/2339] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:53:30.647055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:30.662372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11459eb6-c979-4f24-bd55-a0aa552f704c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:30.667928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:30.668703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:30.669021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:30.669328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] PATH_INFO: `/v3/projects/7b5e6ec0eafd442b86efdfff7701457a/users/7bb56265ddc84543916ad2d7ae8a2c7f/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:30.706029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5e6ec0eafd442b86efdfff7701457a, user_id=7bb56265ddc84543916ad2d7ae8a2c7f, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:30.709272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:30.738671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1162/2340] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:53:30 2022] PUT /identity/v3/projects/7b5e6ec0eafd442b86efdfff7701457a/users/7bb56265ddc84543916ad2d7ae8a2c7f/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:30.742994 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:30.759690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffebac-7bf7-4e8a-9583-39b72b71fdd3 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:30.833016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634151b-a15e-4aea-9903-fe533d016cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:30.833991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634151b-a15e-4aea-9903-fe533d016cbe admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:30.834277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634151b-a15e-4aea-9903-fe533d016cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:30.834551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634151b-a15e-4aea-9903-fe533d016cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:30.835238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634151b-a15e-4aea-9903-fe533d016cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:30.836852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634151b-a15e-4aea-9903-fe533d016cbe admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:30.848574 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1179/2341] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:53:30.853233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:30.864333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbe904-e486-4cba-b44b-0ac028ec4bb1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:30.869379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997bbba-7b77-4719-8165-806504e13dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:30.870311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbba-7b77-4719-8165-806504e13dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:30.870597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbba-7b77-4719-8165-806504e13dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:30.870874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bbba-7b77-4719-8165-806504e13dd9 admin admin] PATH_INFO: `/v3/projects/7b5e6ec0eafd442b86efdfff7701457a/users/7bb56265ddc84543916ad2d7ae8a2c7f/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:30.872838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997bbba-7b77-4719-8165-806504e13dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5e6ec0eafd442b86efdfff7701457a, user_id=7bb56265ddc84543916ad2d7ae8a2c7f, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:30.875558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997bbba-7b77-4719-8165-806504e13dd9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:30.878985 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:30.889385 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1163/2342] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:53:30 2022] PUT /identity/v3/projects/7b5e6ec0eafd442b86efdfff7701457a/users/7bb56265ddc84543916ad2d7ae8a2c7f/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:53:34.723705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:34.724262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:34.724262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:34.753643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] MFA Rules not processed for user `efb98c8e757344aa9b01ad32fdbb8906`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:34.754888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:34.834145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1180/2343] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:36.178938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044520c3-8cfd-47ae-9750-9d80378694e4 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:36.180085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044520c3-8cfd-47ae-9750-9d80378694e4 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:36.180471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044520c3-8cfd-47ae-9750-9d80378694e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:36.204942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-044520c3-8cfd-47ae-9750-9d80378694e4 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:36.206750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-044520c3-8cfd-47ae-9750-9d80378694e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:36.286568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1164/2344] 10.222.0.13 () {58 vars in 967 bytes} [Sat Sep 3 03:53:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:36.303384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:36.305395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:36.398168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b6727-d5c8-4891-a79b-6e8c788290c7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:36.406750 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:36.407821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:36.408217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:36.408604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:36.422251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:36.424539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:36.435755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1181/2345] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:53:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:53:36.883639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20806dae-7e1e-4c4c-8fff-44f6cd17dc83 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:36.883923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20806dae-7e1e-4c4c-8fff-44f6cd17dc83 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:36.884207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20806dae-7e1e-4c4c-8fff-44f6cd17dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:36.948320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-20806dae-7e1e-4c4c-8fff-44f6cd17dc83 None None] MFA Rules not processed for user `7bb56265ddc84543916ad2d7ae8a2c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:36.949606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-20806dae-7e1e-4c4c-8fff-44f6cd17dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:37.065629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1165/2346] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:37.081814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:37.083804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:37.152232 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:37.231772 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8155de2-0537-457e-ba6d-f236ef129fb7 service swift] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:37.237922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22a017e6b1d64044b4f5e3fb67cfd67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:37.239812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:37.240427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:37.240884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:37.377742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:37.379888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:37.391987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1182/2347] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:53:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:53:37.598690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749704-f35f-4b75-8fce-0081440f6b1e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:37.599215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749704-f35f-4b75-8fce-0081440f6b1e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:37.599215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749704-f35f-4b75-8fce-0081440f6b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:37.625168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f8749704-f35f-4b75-8fce-0081440f6b1e None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:37.626461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f8749704-f35f-4b75-8fce-0081440f6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:37.635528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1166/2348] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:53:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:37.648411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:37.665913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca4cb-3cb1-4814-a16b-575d8a710bbb service glance] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:37.671403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923dd23-1567-4f2d-9759-46169bffd73c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:37.672040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923dd23-1567-4f2d-9759-46169bffd73c service swift] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:37.672328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923dd23-1567-4f2d-9759-46169bffd73c service swift] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:37.672603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923dd23-1567-4f2d-9759-46169bffd73c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:37.681785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923dd23-1567-4f2d-9759-46169bffd73c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:37.683569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923dd23-1567-4f2d-9759-46169bffd73c service swift] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:37.693729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1183/2349] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:53:46.731438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378984-7675-476b-a715-8be44cee70ab None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:46.732000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378984-7675-476b-a715-8be44cee70ab None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:46.732000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378984-7675-476b-a715-8be44cee70ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:46.752491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-65378984-7675-476b-a715-8be44cee70ab None None] MFA Rules not processed for user `251c2d3d94364864bb31bf38fa5427cc`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:46.753925 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-65378984-7675-476b-a715-8be44cee70ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:46.761738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1167/2350] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:53:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:53:47.689411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=46 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:48.947942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cf7f4-1076-4a1a-a564-d8b9ccac6620 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:48.948600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cf7f4-1076-4a1a-a564-d8b9ccac6620 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:48.948600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8cf7f4-1076-4a1a-a564-d8b9ccac6620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:48.977376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-3e8cf7f4-1076-4a1a-a564-d8b9ccac6620 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:53:48.979632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3e8cf7f4-1076-4a1a-a564-d8b9ccac6620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:53:48.988609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1184/2351] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:53:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:53:49.004067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378984-7675-476b-a715-8be44cee70ab None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:53:49.022503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378984-7675-476b-a715-8be44cee70ab None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:53:49.028341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:53:49.029276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:53:49.029773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:53:49.030397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:53:49.040811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:53:49.043325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:53:49.057342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1168/2352] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:53:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:53:58.966255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:53:59.051104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=73 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:18.788180 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cf7f4-1076-4a1a-a564-d8b9ccac6620 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:54:18.846873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8cf7f4-1076-4a1a-a564-d8b9ccac6620 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:54:18.851304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:54:18.851914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:54:18.852198 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:54:18.852473 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:54:18.861896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:54:18.863332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:54:18.872927 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1185/2353] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:54:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:54:26.826993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:54:26.828507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:54:26.844334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9060fdb-8a24-4144-afcc-5200c27ec40e service swift] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:54:26.848383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fddcc5-6dc1-4052-9d61-5e369ae8aae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:54:26.849047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fddcc5-6dc1-4052-9d61-5e369ae8aae2 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:54:26.849330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fddcc5-6dc1-4052-9d61-5e369ae8aae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:54:26.849943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fddcc5-6dc1-4052-9d61-5e369ae8aae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:54:26.851724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-57fddcc5-6dc1-4052-9d61-5e369ae8aae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:54:26.931595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fddcc5-6dc1-4052-9d61-5e369ae8aae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:54:26.933063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fddcc5-6dc1-4052-9d61-5e369ae8aae2 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:54:26.944743 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1169/2354] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:54:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:54:28.809074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:54:28.823212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38a808-de2d-42f8-b967-82335434e6f2 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:54:28.830150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:54:28.830901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:54:28.831263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:54:28.831572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:54:28.834606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:54:28.852589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:54:28.854102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:54:28.866966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1186/2355] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:54:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:54:33.911166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dcb4d-5226-4974-bd3f-21ef00886f15 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:54:33.911754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dcb4d-5226-4974-bd3f-21ef00886f15 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:54:33.911754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dcb4d-5226-4974-bd3f-21ef00886f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:54:33.932895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f16dcb4d-5226-4974-bd3f-21ef00886f15 None None] MFA Rules not processed for user `44a51adff4c546da9c7f476e58e2fc88`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:54:33.934120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f16dcb4d-5226-4974-bd3f-21ef00886f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:54:33.993256 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1170/2356] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:54:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:54:38.861288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=32 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:43.986138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=59 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:54:55.190106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:54:55.192406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:54:55.215098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065ce2-7759-4229-a363-a93a3c5f3dfb service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:54:55.223427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f420d-855c-4684-a2ca-c8793ca5e0f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:54:55.223978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f420d-855c-4684-a2ca-c8793ca5e0f5 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:54:55.224565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f420d-855c-4684-a2ca-c8793ca5e0f5 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:54:55.224838 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f420d-855c-4684-a2ca-c8793ca5e0f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:54:55.227148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bb6f420d-855c-4684-a2ca-c8793ca5e0f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:54:55.310901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f420d-855c-4684-a2ca-c8793ca5e0f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:54:55.313131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f420d-855c-4684-a2ca-c8793ca5e0f5 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:54:55.324290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1187/2357] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:54:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:00.138051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dcb4d-5226-4974-bd3f-21ef00886f15 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:00.151898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dcb4d-5226-4974-bd3f-21ef00886f15 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:00.159833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:00.160467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:00.160796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:00.161104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:00.166345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:00.189810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:00.191793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:00.217681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1171/2358] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:03.749847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4c61-9727-417a-98d4-65b34866ae2a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:03.750446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4c61-9727-417a-98d4-65b34866ae2a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:03.750552 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4c61-9727-417a-98d4-65b34866ae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:03.771176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a2ee4c61-9727-417a-98d4-65b34866ae2a None None] MFA Rules not processed for user `1a3d08bbd8aa4338b905ac912d1319fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:55:03.772421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a2ee4c61-9727-417a-98d4-65b34866ae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:03.781231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1188/2359] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:55:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:55:04.099406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:04.110686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da6d68-4760-4c05-a87f-17c3eeb1ea39 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:04.115272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f985f-2c70-4629-944e-273d85ea74d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:04.115899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f985f-2c70-4629-944e-273d85ea74d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:04.116182 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f985f-2c70-4629-944e-273d85ea74d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:04.116454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f985f-2c70-4629-944e-273d85ea74d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:04.118725 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-594f985f-2c70-4629-944e-273d85ea74d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:04.130269 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f985f-2c70-4629-944e-273d85ea74d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:04.131717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f985f-2c70-4629-944e-273d85ea74d2 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:04.141666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1172/2360] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:04.481091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbdb10-e40e-4116-a2a4-0526085e0d6c None None] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:04.481380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbdb10-e40e-4116-a2a4-0526085e0d6c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:04.481648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbdb10-e40e-4116-a2a4-0526085e0d6c None None] PATH_INFO: `/` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:04.483050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1189/2361] 10.222.0.13 () {54 vars in 961 bytes} [Sat Sep 3 03:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 03:55:04.488756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f994c-d7e5-4333-b271-2a0f13c43721 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:04.489086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f994c-d7e5-4333-b271-2a0f13c43721 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:04.489394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f994c-d7e5-4333-b271-2a0f13c43721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:04.510157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-911f994c-d7e5-4333-b271-2a0f13c43721 None None] MFA Rules not processed for user `f28767963d594fef86d3565ea7370c01`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:55:04.511410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-911f994c-d7e5-4333-b271-2a0f13c43721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:04.577388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1173/2362] 10.222.0.13 () {58 vars in 1058 bytes} [Sat Sep 3 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:55:04.589143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbdb10-e40e-4116-a2a4-0526085e0d6c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:04.611474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbdb10-e40e-4116-a2a4-0526085e0d6c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:04.617512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:04.618118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:04.618400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:04.618665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:04.620707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:04.632801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:04.634438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:04.645382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1190/2363] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:06.895967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f994c-d7e5-4333-b271-2a0f13c43721 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:06.895967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f994c-d7e5-4333-b271-2a0f13c43721 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:06.898934 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:06.899572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:06.899852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:06.900122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:06.901884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:06.911588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:06.913064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:06.921174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1174/2364] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:14.640600 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=37 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:15.086675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:15.090650 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:15.118668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e1bb3-23c3-4764-a424-8591589a7596 service placement] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:15.125674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b455044-29f8-4af3-b424-e40ca3121752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:15.126394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b455044-29f8-4af3-b424-e40ca3121752 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:15.126666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b455044-29f8-4af3-b424-e40ca3121752 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:15.126928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b455044-29f8-4af3-b424-e40ca3121752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:15.128844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7b455044-29f8-4af3-b424-e40ca3121752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:15.144645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b455044-29f8-4af3-b424-e40ca3121752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:15.146521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b455044-29f8-4af3-b424-e40ca3121752 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:15.170471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1191/2365] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:16.917619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=47 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:25.153967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=6 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:55:41.623678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:41.638702 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52fc90-e4d9-47cb-991a-9e8445e988a6 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:41.645101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:41.645782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:41.646071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:41.646348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:41.648122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:41.662200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:41.663922 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:41.679948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1175/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:44.850061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68a9c3-2f2d-4358-a63e-df467cd12a57 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:44.850616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68a9c3-2f2d-4358-a63e-df467cd12a57 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:44.850616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68a9c3-2f2d-4358-a63e-df467cd12a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:44.871377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0e68a9c3-2f2d-4358-a63e-df467cd12a57 None None] MFA Rules not processed for user `efb98c8e757344aa9b01ad32fdbb8906`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:55:44.872591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0e68a9c3-2f2d-4358-a63e-df467cd12a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:44.880774 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1192/2367] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:55:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:55:45.211707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:45.222550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd49689-5dad-4b34-864e-36a00ff16d3d service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:45.227218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:45.227827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:45.228104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:45.228393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:45.230341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:45.240078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:45.241551 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:45.249566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1176/2368] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:52.682172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68a9c3-2f2d-4358-a63e-df467cd12a57 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:52.698263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68a9c3-2f2d-4358-a63e-df467cd12a57 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:52.705210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:52.705821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:52.706107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:52.706404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:52.708385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:52.720489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:52.722954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:52.737381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1193/2369] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:54.142289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:54.143971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:54.205303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703cc24-129a-4f1f-83d0-a870bf845d20 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:54.209950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c15b15-8f19-4208-8ffe-b21c11e0ae50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:54.210572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c15b15-8f19-4208-8ffe-b21c11e0ae50 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:54.210845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c15b15-8f19-4208-8ffe-b21c11e0ae50 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:54.211108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c15b15-8f19-4208-8ffe-b21c11e0ae50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:54.213192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-01c15b15-8f19-4208-8ffe-b21c11e0ae50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:54.275128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c15b15-8f19-4208-8ffe-b21c11e0ae50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:54.276584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c15b15-8f19-4208-8ffe-b21c11e0ae50 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:54.286254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1177/2370] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:55:55.963692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:55:55.974053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005d801-9afc-46db-9a6f-0bb6c491cd81 service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:55:55.978122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:55:55.978744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:55:55.978995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:55:55.979265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:55:55.981150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:55:55.992468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:55:55.994045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:55:56.004081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1194/2371] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:55:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:04.281567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=60 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:05.279122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:05.279499 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:05.279915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:05.299926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] MFA Rules not processed for user `e41cfa8ce3a847738325ef2952b41e90`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:05.301175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:05.309212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1178/2372] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:05.999531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=15 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:15.294032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:20.020553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:20.030486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc017b05-7c2c-4423-8ccf-4443e7a97498 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:20.035268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:20.035807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:20.036113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:20.036381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:20.038427 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:20.107431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:20.108931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:20.119827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1195/2373] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:23.767724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:23.769404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:23.785771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13300d3-8e21-4db0-9ab0-cee5c305416e None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:23.790760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:23.791472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:23.791911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:23.792180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] PATH_INFO: `/v3/users/44a51adff4c546da9c7f476e58e2fc88` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:23.793355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a51adff4c546da9c7f476e58e2fc88)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:23.795302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:23.855904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a51adff4c546da9c7f476e58e2fc88'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:23.856654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a51adff4c546da9c7f476e58e2fc88'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:23.865194 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a51adff4c546da9c7f476e58e2fc88'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:23.865827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a51adff4c546da9c7f476e58e2fc88'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:23.877996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6c482ab0-1b25-4bbe-8109-47c92a99d8ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a51adff4c546da9c7f476e58e2fc88'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:23.889837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1179/2374] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:56:23 2022] DELETE /identity/v3/users/44a51adff4c546da9c7f476e58e2fc88 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:24.070415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.081281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab518-909f-4b64-99ef-3bdc8a13eb30 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.142637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.143273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.143555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.143948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] PATH_INFO: `/v3/projects/cf8ed29fbfe24550a6350b98ea0a9a40` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.145226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8ed29fbfe24550a6350b98ea0a9a40)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.147143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.201714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8ed29fbfe24550a6350b98ea0a9a40', 'request_id': 'req-796ea08a-e515-4f8e-9584-dfc4ac71644b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:24.208209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8ed29fbfe24550a6350b98ea0a9a40', 'request_id': 'req-796ea08a-e515-4f8e-9584-dfc4ac71644b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:24.213862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8ed29fbfe24550a6350b98ea0a9a40', 'request_id': 'req-796ea08a-e515-4f8e-9584-dfc4ac71644b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:24.227098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] The token cache is being invalidate because project cf8ed29fbfe24550a6350b98ea0a9a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:56:24.227374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:24.228019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-796ea08a-e515-4f8e-9584-dfc4ac71644b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:24.229549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1196/2375] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:56:24 2022] DELETE /identity/v3/projects/cf8ed29fbfe24550a6350b98ea0a9a40 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:24.234734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fc2e-919c-4aee-b11b-d0a3dc213bc9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.235125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fc2e-919c-4aee-b11b-d0a3dc213bc9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.235400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fc2e-919c-4aee-b11b-d0a3dc213bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.255712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0a35fc2e-919c-4aee-b11b-d0a3dc213bc9 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:24.256852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0a35fc2e-919c-4aee-b11b-d0a3dc213bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:24.323714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1180/2376] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:24.332493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744458b-9ec0-46ed-a0aa-a904956171c7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.332963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744458b-9ec0-46ed-a0aa-a904956171c7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.333408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744458b-9ec0-46ed-a0aa-a904956171c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.359118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8744458b-9ec0-46ed-a0aa-a904956171c7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:24.360404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8744458b-9ec0-46ed-a0aa-a904956171c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:24.368889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1197/2377] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:24.373806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fc2e-919c-4aee-b11b-d0a3dc213bc9 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.384668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fc2e-919c-4aee-b11b-d0a3dc213bc9 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.391087 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.391688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.392003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.392271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.393013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:56:24.393420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.395093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.407676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1181/2378] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:56:24.412943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744458b-9ec0-46ed-a0aa-a904956171c7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.427583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744458b-9ec0-46ed-a0aa-a904956171c7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.436502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.437612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.437867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.438155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.438786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.441482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.460637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:24.477625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1198/2379] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:56:24 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:24.482136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.494060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d425f-83f4-4aa7-aa7b-e2ff0ab01e7e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.557219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.557744 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.558026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.558295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.559043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.561310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.570090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:24.586108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1182/2380] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:56:24 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:24.590293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.601653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd34f6-1c92-4ef2-a1c3-e73ba56c190d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.606989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.607593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.607875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.608145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.608791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.610566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.620940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1199/2381] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:24.626453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.637296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c16a79-986f-406e-a4ca-4b6911796e18 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.642497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d91ea-576e-4230-bdcc-df227593a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.643094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d91ea-576e-4230-bdcc-df227593a159 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.643378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d91ea-576e-4230-bdcc-df227593a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.643651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d91ea-576e-4230-bdcc-df227593a159 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.644297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d91ea-576e-4230-bdcc-df227593a159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.645974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d91ea-576e-4230-bdcc-df227593a159 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.657467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1183/2382] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:24.663418 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.676951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13649e-7f6d-4d45-8ca0-7c7da24fd448 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.682313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.682959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.683236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.683508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] PATH_INFO: `/v3/projects/1a2c368821634a99bc24d7050019d0b5/users/62dc529f0fb4449da7c176e581bc923c/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.700217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2c368821634a99bc24d7050019d0b5, user_id=62dc529f0fb4449da7c176e581bc923c, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.703077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.718541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1200/2383] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:24 2022] PUT /identity/v3/projects/1a2c368821634a99bc24d7050019d0b5/users/62dc529f0fb4449da7c176e581bc923c/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:24.730586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14f41-ac8f-40cc-a122-9af3ebe11218 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.730878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14f41-ac8f-40cc-a122-9af3ebe11218 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.731155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a14f41-ac8f-40cc-a122-9af3ebe11218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.761982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-58a14f41-ac8f-40cc-a122-9af3ebe11218 None None] MFA Rules not processed for user `62dc529f0fb4449da7c176e581bc923c`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:24.763214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-58a14f41-ac8f-40cc-a122-9af3ebe11218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:24.828071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1184/2384] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:24.844995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:24.848539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:24.948308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dddbd-2a93-4d28-8667-2be132915bfc admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:24.954690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c389-b464-49ac-9f0b-1f370aad0180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:24.956088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c389-b464-49ac-9f0b-1f370aad0180 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:24.956366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c389-b464-49ac-9f0b-1f370aad0180 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:24.956636 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c389-b464-49ac-9f0b-1f370aad0180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:24.965008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c389-b464-49ac-9f0b-1f370aad0180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:24.966610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c389-b464-49ac-9f0b-1f370aad0180 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:24.976649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1201/2385] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:25.214368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14f41-ac8f-40cc-a122-9af3ebe11218 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:25.280651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a14f41-ac8f-40cc-a122-9af3ebe11218 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:25.286369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:25.287011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:25.287288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:25.287565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] PATH_INFO: `/v3/users/62dc529f0fb4449da7c176e581bc923c` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:25.288789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dc529f0fb4449da7c176e581bc923c)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:25.292239 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:25.349566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dc529f0fb4449da7c176e581bc923c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.350228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dc529f0fb4449da7c176e581bc923c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.359299 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dc529f0fb4449da7c176e581bc923c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.360061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dc529f0fb4449da7c176e581bc923c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.371008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:25.372237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dc529f0fb4449da7c176e581bc923c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.386664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1185/2386] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:56:25 2022] DELETE /identity/v3/users/62dc529f0fb4449da7c176e581bc923c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:25.396696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:25.397270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:25.397270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:25.417101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:25.418597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:25.480016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1202/2387] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:25.490257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:25.491862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:25.553576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667d216-2efe-41ba-b14f-b5bc47616411 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:25.557673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60f422-7952-4ea7-b2f4-19dbf4f54f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:25.558283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f422-7952-4ea7-b2f4-19dbf4f54f94 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:25.558565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f422-7952-4ea7-b2f4-19dbf4f54f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:25.558835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f422-7952-4ea7-b2f4-19dbf4f54f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:25.568658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60f422-7952-4ea7-b2f4-19dbf4f54f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:25.570178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60f422-7952-4ea7-b2f4-19dbf4f54f94 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:25.580151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1186/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:25.862047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:25.863525 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:25.876430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8a315-5174-45a3-b765-e393e6985ec6 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:25.881451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:25.882121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:25.882403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:25.882682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] PATH_INFO: `/v3/projects/1a2c368821634a99bc24d7050019d0b5` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:25.888220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2c368821634a99bc24d7050019d0b5)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:25.888220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:25.930671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:25.937977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2c368821634a99bc24d7050019d0b5', 'request_id': 'req-4a0a0347-38b7-405e-8afc-3dde904451f9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.946050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2c368821634a99bc24d7050019d0b5', 'request_id': 'req-4a0a0347-38b7-405e-8afc-3dde904451f9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.952320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2c368821634a99bc24d7050019d0b5', 'request_id': 'req-4a0a0347-38b7-405e-8afc-3dde904451f9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.965921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] The token cache is being invalidate because project 1a2c368821634a99bc24d7050019d0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:56:25.966209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.966848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4a0a0347-38b7-405e-8afc-3dde904451f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:25.968367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1203/2389] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:56:25 2022] DELETE /identity/v3/projects/1a2c368821634a99bc24d7050019d0b5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:25.973807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471738-6f69-4fff-9e50-bfad7420e2f8 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:25.974313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471738-6f69-4fff-9e50-bfad7420e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:25.974406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65471738-6f69-4fff-9e50-bfad7420e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:25.994823 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-65471738-6f69-4fff-9e50-bfad7420e2f8 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:25.996036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-65471738-6f69-4fff-9e50-bfad7420e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:26.058754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1187/2390] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:26.067218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462279-0224-4b75-a945-4093387acc09 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.067505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462279-0224-4b75-a945-4093387acc09 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.067813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462279-0224-4b75-a945-4093387acc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.088891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0d462279-0224-4b75-a945-4093387acc09 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:26.090150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0d462279-0224-4b75-a945-4093387acc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:26.099108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1204/2391] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:26.103432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65471738-6f69-4fff-9e50-bfad7420e2f8 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:26.113451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65471738-6f69-4fff-9e50-bfad7420e2f8 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:26.118484 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:26.119116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.119370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.119672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.120320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:56:26.120627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:26.122303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:26.134151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1188/2392] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:56:26.138411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d462279-0224-4b75-a945-4093387acc09 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:26.147912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d462279-0224-4b75-a945-4093387acc09 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:26.153109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:26.153706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.153991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.154260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.154903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:26.156866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:26.189342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1205/2393] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:56:26 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:26.193637 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:26.204093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6358a07-04a8-41ea-8104-b904ffa7518b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:26.267289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:26.267898 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.268173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.268442 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.269128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:26.271096 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:26.294987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1189/2394] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:56:26 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:26.301125 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:26.317589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f972b-d332-49c7-b2b4-a9cac77eec6c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:26.325408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:26.326289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.326664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.327063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.328560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:26.330412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:26.341147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1206/2395] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:26.345903 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:26.356729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8875ac3-35ab-4808-9fff-db4d7487e569 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:26.362136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e877dd2-e561-4a1b-9693-368ac7287d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:26.362730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e877dd2-e561-4a1b-9693-368ac7287d5b admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.363010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e877dd2-e561-4a1b-9693-368ac7287d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.363278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e877dd2-e561-4a1b-9693-368ac7287d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.363914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e877dd2-e561-4a1b-9693-368ac7287d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:26.365648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e877dd2-e561-4a1b-9693-368ac7287d5b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:26.366907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:26.378098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1190/2396] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:26.382364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:26.393176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ecb7f-d4c6-4516-b714-163ab55c10c5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:26.397965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:26.398634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.398887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.399174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] PATH_INFO: `/v3/projects/5044ff88d65c48209b77e0625386ac8e/users/0ff84e80918d487583ca92c4c244dc58/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.417342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5044ff88d65c48209b77e0625386ac8e, user_id=0ff84e80918d487583ca92c4c244dc58, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:26.420097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:26.434845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1207/2397] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:26 2022] PUT /identity/v3/projects/5044ff88d65c48209b77e0625386ac8e/users/0ff84e80918d487583ca92c4c244dc58/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:26.440543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa20b-40cb-4864-b52f-323a38af9991 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.440765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa20b-40cb-4864-b52f-323a38af9991 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.441070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa20b-40cb-4864-b52f-323a38af9991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.460751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-79aaa20b-40cb-4864-b52f-323a38af9991 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:26.462017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-79aaa20b-40cb-4864-b52f-323a38af9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:26.523999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1191/2398] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:26.534086 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:26.535890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:26.596724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17c0d4-9372-4d0b-b696-fd68d67ae974 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:26.600959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:26.601592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:26.601871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:26.602163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:26.611405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:26.612834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:26.622327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1208/2399] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:27.275428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e7f8-34fe-4cf7-9888-d1b8d26955cc None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:27.275960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e7f8-34fe-4cf7-9888-d1b8d26955cc None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:27.276053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906e7f8-34fe-4cf7-9888-d1b8d26955cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:27.306566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2906e7f8-34fe-4cf7-9888-d1b8d26955cc None None] MFA Rules not processed for user `0ff84e80918d487583ca92c4c244dc58`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:27.308789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2906e7f8-34fe-4cf7-9888-d1b8d26955cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:27.385713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1192/2400] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:27.390582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:27.400555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d400-5708-403a-9341-66ca39613184 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:27.405375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:27.406097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:27.406387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:27.406702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:27.407394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:27.409383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:27.442861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1209/2401] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:56:27 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:27.443988 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906e7f8-34fe-4cf7-9888-d1b8d26955cc None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:27.456004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906e7f8-34fe-4cf7-9888-d1b8d26955cc None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:27.512755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:27.513402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:27.513685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:27.513961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:27.514606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:27.517446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:27.539740 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1193/2402] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:56:27 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:27.543813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:27.554468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dba98-d07b-408f-9657-4389a7eb8c5c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:27.560165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:27.560761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:27.561106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:27.561375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:27.562141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:27.563825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:27.574881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1210/2403] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:27.579408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:27.589994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee53044-7c84-4703-9a43-77e5be6da60f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:27.595144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:27.595797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:27.596076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:27.596349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] PATH_INFO: `/v3/projects/260e4241f10140f4b66335e558863a89/users/5a31605c3d6b4d54ae86056ceebb0f36/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:27.609457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:27.612841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260e4241f10140f4b66335e558863a89, user_id=5a31605c3d6b4d54ae86056ceebb0f36, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:27.615711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:27.634319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1194/2404] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:27 2022] PUT /identity/v3/projects/260e4241f10140f4b66335e558863a89/users/5a31605c3d6b4d54ae86056ceebb0f36/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:27.640777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:27.651290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513215-9903-462c-b029-3657cd04e4da admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:27.687988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:27.714392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf26f6-5efb-44dc-b36a-3d29e1ca3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:27.714970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf26f6-5efb-44dc-b36a-3d29e1ca3233 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:27.715254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf26f6-5efb-44dc-b36a-3d29e1ca3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:27.715531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf26f6-5efb-44dc-b36a-3d29e1ca3233 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:27.716170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf26f6-5efb-44dc-b36a-3d29e1ca3233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:27.717813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf26f6-5efb-44dc-b36a-3d29e1ca3233 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:27.728757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1211/2405] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:27.733291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:27.745043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f18b8-3ccf-4858-874e-b77d0c7a32c0 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:27.750577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:27.751236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:27.751517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:27.751794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] PATH_INFO: `/v3/projects/260e4241f10140f4b66335e558863a89/users/5a31605c3d6b4d54ae86056ceebb0f36/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:27.754047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] RBAC: Authorizing `identity:create_grant(project_id=260e4241f10140f4b66335e558863a89, user_id=5a31605c3d6b4d54ae86056ceebb0f36, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:27.756721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:27.768038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1195/2406] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:27 2022] PUT /identity/v3/projects/260e4241f10140f4b66335e558863a89/users/5a31605c3d6b4d54ae86056ceebb0f36/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:28.412491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f784-731e-411d-8365-aae1c7a55e45 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:28.413020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f784-731e-411d-8365-aae1c7a55e45 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:28.413161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f784-731e-411d-8365-aae1c7a55e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:28.441866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c264f784-731e-411d-8365-aae1c7a55e45 None None] MFA Rules not processed for user `5a31605c3d6b4d54ae86056ceebb0f36`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:28.443179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c264f784-731e-411d-8365-aae1c7a55e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:28.525633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1212/2407] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:29.793345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:29.856798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52c69-ed6a-40d7-94c7-5fa66e6b744d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:29.862214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:29.862841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:29.863123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:29.863396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] PATH_INFO: `/v3/users/0ff84e80918d487583ca92c4c244dc58` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:29.864515 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff84e80918d487583ca92c4c244dc58)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:29.866469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:29.914450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff84e80918d487583ca92c4c244dc58'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:29.915106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff84e80918d487583ca92c4c244dc58'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:29.924163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff84e80918d487583ca92c4c244dc58'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:29.924803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff84e80918d487583ca92c4c244dc58'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:29.937264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff84e80918d487583ca92c4c244dc58'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:29.949739 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1196/2408] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:56:29 2022] DELETE /identity/v3/users/0ff84e80918d487583ca92c4c244dc58 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:30.140264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f784-731e-411d-8365-aae1c7a55e45 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:30.151390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f784-731e-411d-8365-aae1c7a55e45 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:30.217554 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:30.218100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:30.218444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:30.218712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] PATH_INFO: `/v3/projects/5044ff88d65c48209b77e0625386ac8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:30.219852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5044ff88d65c48209b77e0625386ac8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:30.221810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:30.283453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5044ff88d65c48209b77e0625386ac8e', 'request_id': 'req-f09a0357-1f3f-45a1-8258-7550c912a4c6'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.290254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5044ff88d65c48209b77e0625386ac8e', 'request_id': 'req-f09a0357-1f3f-45a1-8258-7550c912a4c6'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.294176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:30.296643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5044ff88d65c48209b77e0625386ac8e', 'request_id': 'req-f09a0357-1f3f-45a1-8258-7550c912a4c6'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.309776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] The token cache is being invalidate because project 5044ff88d65c48209b77e0625386ac8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:56:30.310171 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.310813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.312713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1213/2409] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:56:30 2022] DELETE /identity/v3/projects/5044ff88d65c48209b77e0625386ac8e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:30.317911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:30.320177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:30.340971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365aad2-3f75-43ad-9281-409fff1b19bb admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:30.398859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:30.405984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:30.406960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:30.407584 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:30.407904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] PATH_INFO: `/v3/users/5a31605c3d6b4d54ae86056ceebb0f36` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:30.409199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a31605c3d6b4d54ae86056ceebb0f36)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:30.411583 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:30.463625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a31605c3d6b4d54ae86056ceebb0f36'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.464306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a31605c3d6b4d54ae86056ceebb0f36'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.473733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a31605c3d6b4d54ae86056ceebb0f36'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.474319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a31605c3d6b4d54ae86056ceebb0f36'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.486839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e9c7ec43-e636-4e71-89fc-b834de0d36da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a31605c3d6b4d54ae86056ceebb0f36'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.501242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1197/2410] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:56:30 2022] DELETE /identity/v3/users/5a31605c3d6b4d54ae86056ceebb0f36 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:30.691875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:30.693668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:30.712564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a0357-1f3f-45a1-8258-7550c912a4c6 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:30.778104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:30.778756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:30.779040 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:30.779317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] PATH_INFO: `/v3/projects/260e4241f10140f4b66335e558863a89` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:30.780465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] RBAC: Authorizing `identity:delete_project(project_id=260e4241f10140f4b66335e558863a89)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:30.782590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:30.831819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260e4241f10140f4b66335e558863a89', 'request_id': 'req-d6498abb-6796-4316-850d-d5ab3a5b786e'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.837887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260e4241f10140f4b66335e558863a89', 'request_id': 'req-d6498abb-6796-4316-850d-d5ab3a5b786e'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.844450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260e4241f10140f4b66335e558863a89', 'request_id': 'req-d6498abb-6796-4316-850d-d5ab3a5b786e'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.860605 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] The token cache is being invalidate because project 260e4241f10140f4b66335e558863a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:56:30.860900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.861550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-d6498abb-6796-4316-850d-d5ab3a5b786e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:30.863022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1214/2411] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:56:30 2022] DELETE /identity/v3/projects/260e4241f10140f4b66335e558863a89 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:30.868232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359846f6-afce-49e6-9d0a-6e7d86b6d38f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:30.868715 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359846f6-afce-49e6-9d0a-6e7d86b6d38f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:30.868809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359846f6-afce-49e6-9d0a-6e7d86b6d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:30.888816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-359846f6-afce-49e6-9d0a-6e7d86b6d38f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:30.890062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-359846f6-afce-49e6-9d0a-6e7d86b6d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:30.962157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1198/2412] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:30.973252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d768e4-26db-42d0-aa91-f949a24f1865 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:30.973544 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d768e4-26db-42d0-aa91-f949a24f1865 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:30.973791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d768e4-26db-42d0-aa91-f949a24f1865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.000272 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f0d768e4-26db-42d0-aa91-f949a24f1865 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:31.001501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f0d768e4-26db-42d0-aa91-f949a24f1865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:31.011800 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1215/2413] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:31.016333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359846f6-afce-49e6-9d0a-6e7d86b6d38f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.027002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359846f6-afce-49e6-9d0a-6e7d86b6d38f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.032557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.033177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.033452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.033720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.034387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:56:31.034687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.036372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.047951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1199/2414] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:56:31.052476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d768e4-26db-42d0-aa91-f949a24f1865 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.062542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d768e4-26db-42d0-aa91-f949a24f1865 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.069571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.069834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.070121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.070393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.071023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.072955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.108226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1216/2415] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:56:31 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:31.109922 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.120401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44af58-1192-4a2b-b9b8-a9855c9e48dc admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.179081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.179929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.180253 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.180614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.181574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.184523 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.195904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:31.210602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1200/2416] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:56:31 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:31.214777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.225797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987b01-03f5-4491-8150-82b9337e3a23 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.230532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.231132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.231381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.231648 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.232280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.233921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.244018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1217/2417] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:31.248240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.259093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39055d-2390-440c-a9b6-c9eef86edf91 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.264088 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1905766-c574-4543-8665-9bf7abcd8001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.264691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1905766-c574-4543-8665-9bf7abcd8001 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.264968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1905766-c574-4543-8665-9bf7abcd8001 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.265265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1905766-c574-4543-8665-9bf7abcd8001 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.265958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1905766-c574-4543-8665-9bf7abcd8001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.267547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1905766-c574-4543-8665-9bf7abcd8001 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.278319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1201/2418] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:31.282604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.293395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5ea4-1dd3-4717-b1ad-fa0a58442977 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.299395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300034-a977-478b-9106-9104d35da85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.300057 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300034-a977-478b-9106-9104d35da85e admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.300339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300034-a977-478b-9106-9104d35da85e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.300611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300034-a977-478b-9106-9104d35da85e admin admin] PATH_INFO: `/v3/projects/4d12166fe1cb4b9ba0f0c2bff4794f02/users/d4488a68cb604d18a0c70628cbdcbabf/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.320672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300034-a977-478b-9106-9104d35da85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d12166fe1cb4b9ba0f0c2bff4794f02, user_id=d4488a68cb604d18a0c70628cbdcbabf, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.323452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300034-a977-478b-9106-9104d35da85e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.338913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1218/2419] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:31 2022] PUT /identity/v3/projects/4d12166fe1cb4b9ba0f0c2bff4794f02/users/d4488a68cb604d18a0c70628cbdcbabf/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:31.350275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f096c-77a0-496f-aba9-39d77eb2ed31 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.350593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f096c-77a0-496f-aba9-39d77eb2ed31 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.350890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f096c-77a0-496f-aba9-39d77eb2ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.383048 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c43f096c-77a0-496f-aba9-39d77eb2ed31 None None] MFA Rules not processed for user `d4488a68cb604d18a0c70628cbdcbabf`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:31.384265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c43f096c-77a0-496f-aba9-39d77eb2ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:31.462191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1202/2420] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:31.466924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300034-a977-478b-9106-9104d35da85e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.480971 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:31.537161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300034-a977-478b-9106-9104d35da85e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.542309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.542919 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.543203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.543480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.544111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.546068 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.580109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1219/2421] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:56:31 2022] POST /identity/v3/projects => generated 355 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:31.583625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f096c-77a0-496f-aba9-39d77eb2ed31 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.595440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f096c-77a0-496f-aba9-39d77eb2ed31 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.654574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.655191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.655461 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.655729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.656364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.658345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.682242 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1203/2422] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:56:31 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:31.686361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.697634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79709709-2f45-4c19-967d-ffaabf7f9411 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.703286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.703890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.704169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.704436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.705128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.707094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.718146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1220/2423] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:31.723029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.735920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77832268-2d0e-43bb-8e1b-855f11c09375 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.744364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.745077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.745346 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.745625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] PATH_INFO: `/v3/projects/9ec2baa7bd4649e69fdf313dbb99e0a0/users/1d3e759091c14079bfad541546d20c31/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.762575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec2baa7bd4649e69fdf313dbb99e0a0, user_id=1d3e759091c14079bfad541546d20c31, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.765341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.780759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1204/2424] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:31 2022] PUT /identity/v3/projects/9ec2baa7bd4649e69fdf313dbb99e0a0/users/1d3e759091c14079bfad541546d20c31/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:31.784860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.796003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a5ca6-a36b-4066-8bf0-10940a3c2101 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.861091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc81358-27ed-433b-93f8-991d99ca6e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.861687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81358-27ed-433b-93f8-991d99ca6e8a admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.861963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81358-27ed-433b-93f8-991d99ca6e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.862233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc81358-27ed-433b-93f8-991d99ca6e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.862864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc81358-27ed-433b-93f8-991d99ca6e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.864450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc81358-27ed-433b-93f8-991d99ca6e8a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.874507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1221/2425] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:31.881037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:31.897300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504eff-4ac7-43f2-94e3-9de7f02eaad7 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:31.906211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:31.907063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.907357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.907628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] PATH_INFO: `/v3/projects/9ec2baa7bd4649e69fdf313dbb99e0a0/users/1d3e759091c14079bfad541546d20c31/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.909810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec2baa7bd4649e69fdf313dbb99e0a0, user_id=1d3e759091c14079bfad541546d20c31, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:31.912454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:31.924191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1205/2426] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:31 2022] PUT /identity/v3/projects/9ec2baa7bd4649e69fdf313dbb99e0a0/users/1d3e759091c14079bfad541546d20c31/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:31.936252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6f860-5af0-4242-ba87-120d4b04e204 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:31.936647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6f860-5af0-4242-ba87-120d4b04e204 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:31.937039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6f860-5af0-4242-ba87-120d4b04e204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:31.970347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1cc6f860-5af0-4242-ba87-120d4b04e204 None None] MFA Rules not processed for user `1d3e759091c14079bfad541546d20c31`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:31.971588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1cc6f860-5af0-4242-ba87-120d4b04e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:32.040689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1222/2427] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:32.053778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:32.056689 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:32.086888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:32.118633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154afe-893a-44f7-bb07-59eb3410f0df admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:32.122725 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:32.123329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:32.123610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:32.123883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:32.133177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:32.134640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:32.144498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1206/2428] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:32.228503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6f860-5af0-4242-ba87-120d4b04e204 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:32.238614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6f860-5af0-4242-ba87-120d4b04e204 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:32.242781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05767564-71ee-4b56-b7c9-77a4e8b31f9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:32.243411 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05767564-71ee-4b56-b7c9-77a4e8b31f9d service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:32.243701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05767564-71ee-4b56-b7c9-77a4e8b31f9d service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:32.243957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05767564-71ee-4b56-b7c9-77a4e8b31f9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:32.249518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:32.301467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05767564-71ee-4b56-b7c9-77a4e8b31f9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:32.302819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05767564-71ee-4b56-b7c9-77a4e8b31f9d service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:32.312632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1223/2429] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:42.139944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=15 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:42.309727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=24 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:47.490995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:47.566707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7a746-36cc-4694-9c11-67cbdfb7013a service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:47.572076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:47.572699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:47.573141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:47.573411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] PATH_INFO: `/v3/users/d4488a68cb604d18a0c70628cbdcbabf` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:47.574585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4488a68cb604d18a0c70628cbdcbabf)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:47.576526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:47.628600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4488a68cb604d18a0c70628cbdcbabf'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:47.629274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4488a68cb604d18a0c70628cbdcbabf'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:47.638267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4488a68cb604d18a0c70628cbdcbabf'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:47.638986 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4488a68cb604d18a0c70628cbdcbabf'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:47.651319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4488a68cb604d18a0c70628cbdcbabf'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:47.663891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1207/2430] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:56:47 2022] DELETE /identity/v3/users/d4488a68cb604d18a0c70628cbdcbabf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:47.668737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:47.669236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:47.669236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:47.690119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:47.691346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:47.752521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1224/2431] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:47.762814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:47.764345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:47.823683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaeec5-66b6-41dd-b746-102ff3b4f28a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:47.828203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:47.828803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:47.829109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:47.829386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:47.839475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:47.840932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:47.850819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1208/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:48.140298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:48.141825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:48.155188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2cec6-da6f-44be-85c2-6c418bcaf10f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:48.162252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:48.162582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:48.163399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:48.163798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] PATH_INFO: `/v3/projects/4d12166fe1cb4b9ba0f0c2bff4794f02` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:48.165438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d12166fe1cb4b9ba0f0c2bff4794f02)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:48.167735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:48.219706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d12166fe1cb4b9ba0f0c2bff4794f02', 'request_id': 'req-6d3844d0-33fa-4ba2-9951-e8dd67383a86'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.226421 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d12166fe1cb4b9ba0f0c2bff4794f02', 'request_id': 'req-6d3844d0-33fa-4ba2-9951-e8dd67383a86'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.232501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d12166fe1cb4b9ba0f0c2bff4794f02', 'request_id': 'req-6d3844d0-33fa-4ba2-9951-e8dd67383a86'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.247904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] The token cache is being invalidate because project 4d12166fe1cb4b9ba0f0c2bff4794f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:56:48.248173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.248816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.250405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1225/2433] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:56:48 2022] DELETE /identity/v3/projects/4d12166fe1cb4b9ba0f0c2bff4794f02 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:48.254776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:48.265365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aebc4a-94b5-489b-8a52-1b38fafbcfe3 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:48.285850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:48.329371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:48.330020 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:48.330280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:48.330549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] PATH_INFO: `/v3/users/1d3e759091c14079bfad541546d20c31` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:48.331650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3e759091c14079bfad541546d20c31)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:48.333695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:48.390592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3e759091c14079bfad541546d20c31'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.391293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3e759091c14079bfad541546d20c31'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.402612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3e759091c14079bfad541546d20c31'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.403296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3e759091c14079bfad541546d20c31'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.416079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f7022282-6337-4a5a-9b32-eb0f674a198e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3e759091c14079bfad541546d20c31'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.428829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1209/2434] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:56:48 2022] DELETE /identity/v3/users/1d3e759091c14079bfad541546d20c31 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:48.725545 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:48.727279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:48.742891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3844d0-33fa-4ba2-9951-e8dd67383a86 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:48.803489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:48.804069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:48.804354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:48.804629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] PATH_INFO: `/v3/projects/9ec2baa7bd4649e69fdf313dbb99e0a0` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:48.805785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec2baa7bd4649e69fdf313dbb99e0a0)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:48.807725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:48.840035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:48.858708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec2baa7bd4649e69fdf313dbb99e0a0', 'request_id': 'req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.865032 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec2baa7bd4649e69fdf313dbb99e0a0', 'request_id': 'req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.871997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec2baa7bd4649e69fdf313dbb99e0a0', 'request_id': 'req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.885382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] The token cache is being invalidate because project 9ec2baa7bd4649e69fdf313dbb99e0a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:56:48.885677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.886319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7854bfbf-4535-43a7-b6c1-b45a094a9c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:48.887841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1226/2435] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:56:48 2022] DELETE /identity/v3/projects/9ec2baa7bd4649e69fdf313dbb99e0a0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:48.894519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a4acb-2002-4f77-b6c7-aa1f50017b07 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:48.895013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a4acb-2002-4f77-b6c7-aa1f50017b07 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:48.895111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a4acb-2002-4f77-b6c7-aa1f50017b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:48.915835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2c5a4acb-2002-4f77-b6c7-aa1f50017b07 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:48.917068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2c5a4acb-2002-4f77-b6c7-aa1f50017b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:48.978654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1210/2436] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:48.987361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acef7-70e4-4224-ae9b-b48e145296ae None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:48.987710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acef7-70e4-4224-ae9b-b48e145296ae None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:48.988053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acef7-70e4-4224-ae9b-b48e145296ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.016787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-db3acef7-70e4-4224-ae9b-b48e145296ae None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:49.018039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-db3acef7-70e4-4224-ae9b-b48e145296ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:49.027119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1227/2437] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:49.031835 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a4acb-2002-4f77-b6c7-aa1f50017b07 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:49.042579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a4acb-2002-4f77-b6c7-aa1f50017b07 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:49.047957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:49.048569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.048850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.049191 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.049869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:56:49.050172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:49.051807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:49.064368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1211/2438] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:56:49.068739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3acef7-70e4-4224-ae9b-b48e145296ae None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:49.078488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3acef7-70e4-4224-ae9b-b48e145296ae None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:49.084423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:49.085048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.085347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.085661 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.086228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:49.088131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:49.120905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1228/2439] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:56:49 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:49.127604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:49.140264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7dbab-aee5-45d1-9102-a73b9508a349 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:49.171697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:49.208397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:49.209036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.209318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.209588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.210212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:49.212780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:49.235651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1212/2440] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:56:49 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:49.239878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:49.251139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5922-21e1-4e52-a2ab-7297f680d074 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:49.256160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:49.256782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.257092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.257844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.258508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:49.260104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:49.270196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1229/2441] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:49.274290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:49.285039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc494c7-4b65-4259-8d44-8830c65f2231 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:49.290620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c07f8f-05c1-45bc-af19-602a9c876c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:49.291228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07f8f-05c1-45bc-af19-602a9c876c6b admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.291514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07f8f-05c1-45bc-af19-602a9c876c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.291789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c07f8f-05c1-45bc-af19-602a9c876c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.292429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c07f8f-05c1-45bc-af19-602a9c876c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:49.294069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c07f8f-05c1-45bc-af19-602a9c876c6b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:49.305957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1213/2442] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:49.310109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:49.321025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9743-7db6-4de6-96d7-baf07b31096b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:49.326428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:49.327191 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.327475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.327745 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] PATH_INFO: `/v3/projects/792708d60c8d449bb1a9cca9d2243fa5/users/76585c9c3cfd4c1f93aaf8d23b4c3ba5/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.343439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=792708d60c8d449bb1a9cca9d2243fa5, user_id=76585c9c3cfd4c1f93aaf8d23b4c3ba5, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:49.346177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:49.361482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1230/2443] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:49 2022] PUT /identity/v3/projects/792708d60c8d449bb1a9cca9d2243fa5/users/76585c9c3cfd4c1f93aaf8d23b4c3ba5/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:49.374012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07977e1-7829-44e0-beff-5f380694f3d9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.374281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07977e1-7829-44e0-beff-5f380694f3d9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.374742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07977e1-7829-44e0-beff-5f380694f3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.404692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f07977e1-7829-44e0-beff-5f380694f3d9 None None] MFA Rules not processed for user `76585c9c3cfd4c1f93aaf8d23b4c3ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:49.405951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f07977e1-7829-44e0-beff-5f380694f3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:49.474342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1214/2444] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:49.485523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:49.487355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:49.555387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a690b-caf5-466d-902e-b39a1aaaf2ae admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:49.559463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab9255-00e4-4332-ba4d-556e8126a3bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:49.560226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab9255-00e4-4332-ba4d-556e8126a3bd service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:49.560511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab9255-00e4-4332-ba4d-556e8126a3bd service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:49.560786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab9255-00e4-4332-ba4d-556e8126a3bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:49.571594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab9255-00e4-4332-ba4d-556e8126a3bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:49.572968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab9255-00e4-4332-ba4d-556e8126a3bd service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:49.582764 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1231/2445] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:55.024908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07977e1-7829-44e0-beff-5f380694f3d9 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:55.092544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07977e1-7829-44e0-beff-5f380694f3d9 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:55.098136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:55.098789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.099070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.099340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] PATH_INFO: `/v3/users/76585c9c3cfd4c1f93aaf8d23b4c3ba5` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.100536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76585c9c3cfd4c1f93aaf8d23b4c3ba5)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:55.102622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:55.145942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:55.153193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76585c9c3cfd4c1f93aaf8d23b4c3ba5'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.154056 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76585c9c3cfd4c1f93aaf8d23b4c3ba5'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.163490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76585c9c3cfd4c1f93aaf8d23b4c3ba5'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.164151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76585c9c3cfd4c1f93aaf8d23b4c3ba5'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.177935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76585c9c3cfd4c1f93aaf8d23b4c3ba5'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.190839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1215/2446] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:56:55 2022] DELETE /identity/v3/users/76585c9c3cfd4c1f93aaf8d23b4c3ba5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:55.195513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.195977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.196071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.215499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:55.216698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:55.264770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:55.279546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1232/2447] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:55.295796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:55.297504 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:55.361996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee2522-7192-4a8a-8b3d-0b292400b462 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:55.365735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7611a39-a2cb-4fc8-933a-30722942be4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:55.366342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611a39-a2cb-4fc8-933a-30722942be4c service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.366618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611a39-a2cb-4fc8-933a-30722942be4c service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.366869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611a39-a2cb-4fc8-933a-30722942be4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.376776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7611a39-a2cb-4fc8-933a-30722942be4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:55.378263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7611a39-a2cb-4fc8-933a-30722942be4c service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:55.388070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1216/2448] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:56:55.669295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:55.671090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:55.683910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bc7d1-5bdb-4459-97c5-8a9f16d1579f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:55.688676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:55.689345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.689619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.689889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] PATH_INFO: `/v3/projects/792708d60c8d449bb1a9cca9d2243fa5` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.691010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792708d60c8d449bb1a9cca9d2243fa5)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:55.692929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:55.744012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792708d60c8d449bb1a9cca9d2243fa5', 'request_id': 'req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.750830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792708d60c8d449bb1a9cca9d2243fa5', 'request_id': 'req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.758126 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792708d60c8d449bb1a9cca9d2243fa5', 'request_id': 'req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.771982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] The token cache is being invalidate because project 792708d60c8d449bb1a9cca9d2243fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:56:55.772282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.772962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8e67ef65-0e60-49b7-9249-d02fbccc6ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:56:55.774622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1233/2449] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:56:55 2022] DELETE /identity/v3/projects/792708d60c8d449bb1a9cca9d2243fa5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:55.779874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb5daf-d5cb-49a4-a2de-fa94f30a1337 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.780154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb5daf-d5cb-49a4-a2de-fa94f30a1337 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.780427 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb5daf-d5cb-49a4-a2de-fa94f30a1337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.800675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b6cb5daf-d5cb-49a4-a2de-fa94f30a1337 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:55.801910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b6cb5daf-d5cb-49a4-a2de-fa94f30a1337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:55.861012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1217/2450] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:56:55.869389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36761ee-6d12-4fc9-9d7e-d1da06ed1090 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.869686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36761ee-6d12-4fc9-9d7e-d1da06ed1090 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.869986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36761ee-6d12-4fc9-9d7e-d1da06ed1090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.890732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-d36761ee-6d12-4fc9-9d7e-d1da06ed1090 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:55.891955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d36761ee-6d12-4fc9-9d7e-d1da06ed1090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:55.901481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1234/2451] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:56:55.906489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb5daf-d5cb-49a4-a2de-fa94f30a1337 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:55.917431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb5daf-d5cb-49a4-a2de-fa94f30a1337 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:55.923601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:55.924231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.924509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.924777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.925482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:56:55.925789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:55.927464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:55.943654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1218/2452] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:56:55.949558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36761ee-6d12-4fc9-9d7e-d1da06ed1090 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:55.959229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36761ee-6d12-4fc9-9d7e-d1da06ed1090 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:55.964672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:55.965317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:55.965598 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:55.965874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:55.966513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:55.968429 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:56.000676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1235/2453] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:56:55 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:56.005490 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:56.017328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763909b-bce5-4d84-80d1-f37502b0491f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:56.064718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:56:56.079799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:56.080424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:56.080691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:56.080996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:56.081627 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:56.083580 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:56.109119 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1219/2454] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:56:56 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:56:56.113309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:56.124938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cf29e-2175-4fd1-876d-91c19bab040b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:56.129900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:56.130502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:56.130781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:56.131061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:56.131730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:56.133388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:56.143709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1236/2455] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:56.147755 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:56.162138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac973-bf1d-4a3e-9aff-62f91c48e42e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:56.163519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb45dc8-5bc8-47f2-92e5-b48f34836886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:56.164230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb45dc8-5bc8-47f2-92e5-b48f34836886 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:56.164386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb45dc8-5bc8-47f2-92e5-b48f34836886 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:56.164648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb45dc8-5bc8-47f2-92e5-b48f34836886 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:56.165429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb45dc8-5bc8-47f2-92e5-b48f34836886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:56.167093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb45dc8-5bc8-47f2-92e5-b48f34836886 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:56.178284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1220/2456] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:56:56.182724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:56.193078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b0254-d43e-49a8-901a-cf00f2a7ed55 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:56.198262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:56.198892 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:56.199202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:56.199476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] PATH_INFO: `/v3/projects/c4add0e2e0e748f1bd04fa14a3fa15b8/users/eb3aba1f7a6546f288b8556a6abf491d/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:56.215119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4add0e2e0e748f1bd04fa14a3fa15b8, user_id=eb3aba1f7a6546f288b8556a6abf491d, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:56.217862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:56.233170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1237/2457] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:56:56 2022] PUT /identity/v3/projects/c4add0e2e0e748f1bd04fa14a3fa15b8/users/eb3aba1f7a6546f288b8556a6abf491d/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:56:56.243864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fb5a8-cf57-46c4-8b2e-dee2f629d0bf None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:56.244158 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fb5a8-cf57-46c4-8b2e-dee2f629d0bf None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:56.244429 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fb5a8-cf57-46c4-8b2e-dee2f629d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:56.275255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-db4fb5a8-cf57-46c4-8b2e-dee2f629d0bf None None] MFA Rules not processed for user `eb3aba1f7a6546f288b8556a6abf491d`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:56:56.276465 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-db4fb5a8-cf57-46c4-8b2e-dee2f629d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:56.344488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1221/2458] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:56:56.356145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:56:56.358088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:56:56.419818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae1d8f-2d12-4782-8e49-84eddd635ba5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:56:56.424028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8a67a-cdf3-4cde-beee-6417497af3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:56:56.424611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8a67a-cdf3-4cde-beee-6417497af3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:56:56.424902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8a67a-cdf3-4cde-beee-6417497af3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:56:56.425185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8a67a-cdf3-4cde-beee-6417497af3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:56:56.434518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8a67a-cdf3-4cde-beee-6417497af3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:56:56.435990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8a67a-cdf3-4cde-beee-6417497af3e1 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:56:56.445258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1238/2459] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:56:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:57:06.341200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:06.441420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:06.719187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fb5a8-cf57-46c4-8b2e-dee2f629d0bf None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:06.786883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fb5a8-cf57-46c4-8b2e-dee2f629d0bf None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:06.792581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:06.793271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:06.793553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:06.793829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] PATH_INFO: `/v3/users/eb3aba1f7a6546f288b8556a6abf491d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:06.795073 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3aba1f7a6546f288b8556a6abf491d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:06.797147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:06.849590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3aba1f7a6546f288b8556a6abf491d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:06.850268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3aba1f7a6546f288b8556a6abf491d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:06.859889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3aba1f7a6546f288b8556a6abf491d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:06.860510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3aba1f7a6546f288b8556a6abf491d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:06.874861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3aba1f7a6546f288b8556a6abf491d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:06.888280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1222/2460] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:57:06 2022] DELETE /identity/v3/users/eb3aba1f7a6546f288b8556a6abf491d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:57:06.893016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:06.893289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:06.893564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:06.913319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:57:06.914553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:06.980645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1239/2461] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:57:06.990548 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:06.992251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:07.052053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3a2d-acfe-4e9a-9b12-61d632f779e5 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:07.056350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeeb8c-13db-4078-aae0-c796eeddd211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:07.056967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeeb8c-13db-4078-aae0-c796eeddd211 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:07.057260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeeb8c-13db-4078-aae0-c796eeddd211 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:07.057534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeeb8c-13db-4078-aae0-c796eeddd211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:07.068036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aeeb8c-13db-4078-aae0-c796eeddd211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:07.069524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aeeb8c-13db-4078-aae0-c796eeddd211 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:07.079400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1223/2462] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:57:07.364871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:07.366331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:07.383496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8e17-6d4b-4b0a-beca-2651ba801360 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:07.390300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:07.390963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:07.391242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:07.391556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] PATH_INFO: `/v3/projects/c4add0e2e0e748f1bd04fa14a3fa15b8` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:07.392713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4add0e2e0e748f1bd04fa14a3fa15b8)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:07.394795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:07.448675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4add0e2e0e748f1bd04fa14a3fa15b8', 'request_id': 'req-56fd872c-1abd-421e-a372-fa6c6938c2f8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:07.455378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4add0e2e0e748f1bd04fa14a3fa15b8', 'request_id': 'req-56fd872c-1abd-421e-a372-fa6c6938c2f8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:07.461302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4add0e2e0e748f1bd04fa14a3fa15b8', 'request_id': 'req-56fd872c-1abd-421e-a372-fa6c6938c2f8'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:07.476579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] The token cache is being invalidate because project c4add0e2e0e748f1bd04fa14a3fa15b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:57:07.477181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:07.477823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:57:07.479405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1240/2463] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:57:07 2022] DELETE /identity/v3/projects/c4add0e2e0e748f1bd04fa14a3fa15b8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:57:15.379592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1093-83c4-4585-9059-dba372347076 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:15.380148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1093-83c4-4585-9059-dba372347076 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:15.380148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c1093-83c4-4585-9059-dba372347076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:15.400183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d57c1093-83c4-4585-9059-dba372347076 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:57:15.401545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d57c1093-83c4-4585-9059-dba372347076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:15.421751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:15.470102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1224/2464] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:57:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:57:15.511646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:15.513379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:15.586697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd872c-1abd-421e-a372-fa6c6938c2f8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:15.592430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2b741-8c20-4e74-acf1-fc9a5e7b4f00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:15.593072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b741-8c20-4e74-acf1-fc9a5e7b4f00 service swift] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:15.593333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b741-8c20-4e74-acf1-fc9a5e7b4f00 service swift] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:15.593606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2b741-8c20-4e74-acf1-fc9a5e7b4f00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:15.602130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b741-8c20-4e74-acf1-fc9a5e7b4f00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:15.603837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2b741-8c20-4e74-acf1-fc9a5e7b4f00 service swift] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:15.612138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1241/2465] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:57:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:57:25.463845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=15 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:25.608893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:30.776114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1093-83c4-4585-9059-dba372347076 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:30.777693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d57c1093-83c4-4585-9059-dba372347076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:30.946225 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c1093-83c4-4585-9059-dba372347076 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:30.951728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:30.952343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:30.952619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:30.952893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:30.954923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:30.967041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:30.968635 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:30.978954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1225/2466] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:57:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:57:32.310788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813903-59cc-4bdb-9e17-0fbb4b03925a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:32.311308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813903-59cc-4bdb-9e17-0fbb4b03925a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:32.311308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813903-59cc-4bdb-9e17-0fbb4b03925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:32.342042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-cf813903-59cc-4bdb-9e17-0fbb4b03925a None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:57:32.343250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cf813903-59cc-4bdb-9e17-0fbb4b03925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:32.358236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1242/2467] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 03:57:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:57:32.370202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:32.382229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323dae3-6b3a-4333-86a1-200e181720fa service placement] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:32.388423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:32.389069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:32.389353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:32.389622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:32.398464 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:32.400245 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:32.408940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1226/2468] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:57:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:57:42.352328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=10 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:42.405728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=69 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:57:55.440507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17bbd0-18d6-410c-9208-6b29ed25d5b8 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:55.441065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17bbd0-18d6-410c-9208-6b29ed25d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:55.441065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17bbd0-18d6-410c-9208-6b29ed25d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:55.460316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ee17bbd0-18d6-410c-9208-6b29ed25d5b8 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:57:55.461556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ee17bbd0-18d6-410c-9208-6b29ed25d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:55.470470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1243/2469] 10.222.0.13 () {58 vars in 967 bytes} [Sat Sep 3 03:57:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:57:55.486066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:55.496902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6b4a8-86a0-4368-ae0a-6ac14f3f194f service swift] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:55.502908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:55.503502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:55.503786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:55.504060 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:55.513180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:55.514734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:55.522927 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1227/2470] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:57:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:57:57.095993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a549-d44b-45d7-8d5c-6276dcb30e80 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:57.096816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a549-d44b-45d7-8d5c-6276dcb30e80 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:57.096944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a549-d44b-45d7-8d5c-6276dcb30e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:57.116386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-9fa3a549-d44b-45d7-8d5c-6276dcb30e80 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:57:57.117769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9fa3a549-d44b-45d7-8d5c-6276dcb30e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:57:57.126182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1244/2471] 10.222.0.13 () {58 vars in 967 bytes} [Sat Sep 3 03:57:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:57:57.139700 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:57:57.152355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5c23-76b1-4ec6-b83d-998cf6fde78d service swift] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:57:57.157926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdd19c-1553-433c-9748-b41ed13246f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:57:57.158629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdd19c-1553-433c-9748-b41ed13246f5 service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:57:57.158969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdd19c-1553-433c-9748-b41ed13246f5 service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:57:57.159314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdd19c-1553-433c-9748-b41ed13246f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:57:57.170712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdd19c-1553-433c-9748-b41ed13246f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:57:57.172852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdd19c-1553-433c-9748-b41ed13246f5 service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:57:57.182530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1228/2472] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 03:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 03:58:01.164249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a549-d44b-45d7-8d5c-6276dcb30e80 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:01.184024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a549-d44b-45d7-8d5c-6276dcb30e80 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:01.190434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:01.191277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:01.191687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:01.192081 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:01.194118 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:01.207433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:01.209124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:01.222141 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1245/2473] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:02.149297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb0394-d28b-4d74-8060-a18791f4295a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:02.149862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb0394-d28b-4d74-8060-a18791f4295a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:02.149862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb0394-d28b-4d74-8060-a18791f4295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:02.181272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d3cb0394-d28b-4d74-8060-a18791f4295a None None] MFA Rules not processed for user `efb98c8e757344aa9b01ad32fdbb8906`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:02.182520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d3cb0394-d28b-4d74-8060-a18791f4295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:02.240748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1229/2474] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:05.920546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:05.924466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:06.047672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1d8c-60ae-4b19-8bf0-95948fa2b44a service placement] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:06.052480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:06.053168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:06.053454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:06.053730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] PATH_INFO: `/v3/users/251c2d3d94364864bb31bf38fa5427cc` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:06.056054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=251c2d3d94364864bb31bf38fa5427cc)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:06.058092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:06.108260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251c2d3d94364864bb31bf38fa5427cc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.108862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251c2d3d94364864bb31bf38fa5427cc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.116090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251c2d3d94364864bb31bf38fa5427cc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.124380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251c2d3d94364864bb31bf38fa5427cc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.125164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251c2d3d94364864bb31bf38fa5427cc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.143752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1246/2475] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:05 2022] DELETE /identity/v3/users/251c2d3d94364864bb31bf38fa5427cc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:06.332607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb0394-d28b-4d74-8060-a18791f4295a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:06.347457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb0394-d28b-4d74-8060-a18791f4295a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:06.411226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:06.411863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:06.412140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:06.412412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] PATH_INFO: `/v3/projects/57712f274aa3413c9b9a7334507f7a71` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:06.413527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57712f274aa3413c9b9a7334507f7a71)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:06.415507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:06.468876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57712f274aa3413c9b9a7334507f7a71', 'request_id': 'req-19add10b-ca52-4848-b482-b114d7aa3615'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.479149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57712f274aa3413c9b9a7334507f7a71', 'request_id': 'req-19add10b-ca52-4848-b482-b114d7aa3615'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.488531 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57712f274aa3413c9b9a7334507f7a71', 'request_id': 'req-19add10b-ca52-4848-b482-b114d7aa3615'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.511704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] The token cache is being invalidate because project 57712f274aa3413c9b9a7334507f7a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:06.512147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.513364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.515865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1230/2476] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:06 2022] DELETE /identity/v3/projects/57712f274aa3413c9b9a7334507f7a71 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:06.520127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:06.521924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:06.540664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58628c54-772c-43b1-b6c3-d8cbcd46c61b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:06.562653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:06.608768 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:06.609510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:06.609793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:06.610089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] PATH_INFO: `/v3/users/7bb56265ddc84543916ad2d7ae8a2c7f` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:06.611383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb56265ddc84543916ad2d7ae8a2c7f)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:06.613517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:06.663400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb56265ddc84543916ad2d7ae8a2c7f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.664278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb56265ddc84543916ad2d7ae8a2c7f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.673458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb56265ddc84543916ad2d7ae8a2c7f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.683132 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb56265ddc84543916ad2d7ae8a2c7f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.683857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb56265ddc84543916ad2d7ae8a2c7f'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:06.701430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1247/2477] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:06 2022] DELETE /identity/v3/users/7bb56265ddc84543916ad2d7ae8a2c7f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:06.980268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:06.982089 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:06.997889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add10b-ca52-4848-b482-b114d7aa3615 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:07.016788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:07.083122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:07.083767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:07.084047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:07.084321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] PATH_INFO: `/v3/projects/7b5e6ec0eafd442b86efdfff7701457a` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:07.085477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5e6ec0eafd442b86efdfff7701457a)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:07.087391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:07.137212 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5e6ec0eafd442b86efdfff7701457a', 'request_id': 'req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:07.145659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5e6ec0eafd442b86efdfff7701457a', 'request_id': 'req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:07.151332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5e6ec0eafd442b86efdfff7701457a', 'request_id': 'req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:07.163648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] The token cache is being invalidate because project 7b5e6ec0eafd442b86efdfff7701457a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:07.163936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:07.164929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:07.176979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1231/2478] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:06 2022] DELETE /identity/v3/projects/7b5e6ec0eafd442b86efdfff7701457a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:16.698011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:17.160244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:25.311597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:25.313443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:25.395538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930059b8-60d1-461a-b05d-8a3c81c65cbf admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:25.450941 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:25.451557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:25.451888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:25.452127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:25.454506 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:25.525014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:25.526404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:25.536514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1248/2479] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:28.828260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:28.830111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:28.844199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e1ac3-946e-4ad4-a1e8-f3b8f7d7ed3d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:28.850143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:28.850816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:28.851094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:28.851366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] PATH_INFO: `/v3/users/e41cfa8ce3a847738325ef2952b41e90` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:28.852601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41cfa8ce3a847738325ef2952b41e90)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:28.854653 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:28.907962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41cfa8ce3a847738325ef2952b41e90'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:28.908692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41cfa8ce3a847738325ef2952b41e90'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:28.917707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41cfa8ce3a847738325ef2952b41e90'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:28.918326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41cfa8ce3a847738325ef2952b41e90'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:28.930288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-40276165-d38c-4a33-b9f8-a88f70e43982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41cfa8ce3a847738325ef2952b41e90'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:28.943397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1232/2480] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:28 2022] DELETE /identity/v3/users/e41cfa8ce3a847738325ef2952b41e90 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:29.130718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.141131 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e047-a7a6-4289-8f41-29f823b4bc18 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:29.193567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:29.208183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:29.208857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.209162 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.209435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] PATH_INFO: `/v3/projects/0553b255ab8541f6b30337b5f7b75ccc` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.210609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0553b255ab8541f6b30337b5f7b75ccc)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:29.212503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:29.263949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0553b255ab8541f6b30337b5f7b75ccc', 'request_id': 'req-598b780c-3136-4174-aa75-5f9cd75ec8d9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:29.270885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0553b255ab8541f6b30337b5f7b75ccc', 'request_id': 'req-598b780c-3136-4174-aa75-5f9cd75ec8d9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:29.276333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0553b255ab8541f6b30337b5f7b75ccc', 'request_id': 'req-598b780c-3136-4174-aa75-5f9cd75ec8d9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:29.291763 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] The token cache is being invalidate because project 0553b255ab8541f6b30337b5f7b75ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:29.292079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:29.292802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-598b780c-3136-4174-aa75-5f9cd75ec8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:29.296790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1249/2481] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:29 2022] DELETE /identity/v3/projects/0553b255ab8541f6b30337b5f7b75ccc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:29.300945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6872b7-149f-4cf6-95eb-a6d3028274e7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.301355 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6872b7-149f-4cf6-95eb-a6d3028274e7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.301698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6872b7-149f-4cf6-95eb-a6d3028274e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.366431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-3d6872b7-149f-4cf6-95eb-a6d3028274e7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:29.367667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-3d6872b7-149f-4cf6-95eb-a6d3028274e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:29.454645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1233/2482] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:29.462731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da7802-e235-4665-8906-f63582e8d89b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.462992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da7802-e235-4665-8906-f63582e8d89b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.463265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da7802-e235-4665-8906-f63582e8d89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.487318 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-b4da7802-e235-4665-8906-f63582e8d89b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:29.488692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b4da7802-e235-4665-8906-f63582e8d89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:29.498025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1250/2483] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:29.502540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6872b7-149f-4cf6-95eb-a6d3028274e7 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.512938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6872b7-149f-4cf6-95eb-a6d3028274e7 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:29.518625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:29.519291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.519566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.519841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.520506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:58:29.520810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:29.522517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:29.535405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1234/2484] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:58:29.542101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da7802-e235-4665-8906-f63582e8d89b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.553831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da7802-e235-4665-8906-f63582e8d89b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:29.559609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:29.560217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.560498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.560767 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.561430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:29.563492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:29.594791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1251/2485] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:29 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:29.600756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.610890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2599-994c-4ad6-b798-2ef172799e0d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:29.636947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:29.669526 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:29.670150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.670384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.670661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.671282 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:29.673382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:29.695408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1235/2486] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:29 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:29.699716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.710469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54f43a-a2e1-454b-8d70-3b931cdf504a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:29.715930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:29.716539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.716824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.717166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.717900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:29.719646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:29.730455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1252/2487] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:29.734370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.749579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e29c0-c8de-4c96-a0be-7841be8c5b57 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:29.758817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96654616-ff84-417f-94be-170522bc628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:29.760028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96654616-ff84-417f-94be-170522bc628a admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.760378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96654616-ff84-417f-94be-170522bc628a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.760657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96654616-ff84-417f-94be-170522bc628a admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.761350 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96654616-ff84-417f-94be-170522bc628a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:29.764527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96654616-ff84-417f-94be-170522bc628a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:29.776973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1236/2488] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:58:29.781602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.794358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277b94b-6635-4d73-8f39-bea0179616e3 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:29.803616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:29.804645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.804902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.805294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] PATH_INFO: `/v3/projects/0b86d84d00104cbaaf6c2a5a750d4523/users/7b7d63c69618421eb607015c63382f98/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.825196 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b86d84d00104cbaaf6c2a5a750d4523, user_id=7b7d63c69618421eb607015c63382f98, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:29.827992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:29.845677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1253/2489] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:29 2022] PUT /identity/v3/projects/0b86d84d00104cbaaf6c2a5a750d4523/users/7b7d63c69618421eb607015c63382f98/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:58:29.858133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d542-f0b6-405b-a567-c982e23cb1c9 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:29.858648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d542-f0b6-405b-a567-c982e23cb1c9 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:29.858648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d542-f0b6-405b-a567-c982e23cb1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:29.892932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-0358d542-f0b6-405b-a567-c982e23cb1c9 None None] MFA Rules not processed for user `7b7d63c69618421eb607015c63382f98`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:29.894195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0358d542-f0b6-405b-a567-c982e23cb1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:29.960215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1237/2490] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:29.973713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:29.976676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:30.063430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:30.090651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e54e-25ed-40ed-bd45-cf111ec31b0e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:30.097282 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ef7b-0238-4f95-9edc-d76612f6c02f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:30.097894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ef7b-0238-4f95-9edc-d76612f6c02f service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:30.098176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ef7b-0238-4f95-9edc-d76612f6c02f service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:30.098451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ef7b-0238-4f95-9edc-d76612f6c02f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:30.106413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ef7b-0238-4f95-9edc-d76612f6c02f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:30.108031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ef7b-0238-4f95-9edc-d76612f6c02f service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:30.117384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1254/2491] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:32.880708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d542-f0b6-405b-a567-c982e23cb1c9 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:32.951559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d542-f0b6-405b-a567-c982e23cb1c9 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:32.956901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:32.957564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:32.957845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:32.958120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] PATH_INFO: `/v3/users/7b7d63c69618421eb607015c63382f98` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:32.959314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7d63c69618421eb607015c63382f98)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:32.961310 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:33.011226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:33.018852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7d63c69618421eb607015c63382f98'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.019685 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7d63c69618421eb607015c63382f98'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.029247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7d63c69618421eb607015c63382f98'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.029886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7d63c69618421eb607015c63382f98'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.042049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7d63c69618421eb607015c63382f98'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.057798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1238/2492] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:32 2022] DELETE /identity/v3/users/7b7d63c69618421eb607015c63382f98 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:33.063237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.063797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.063940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.084291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:33.085557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:33.145874 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1255/2493] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:33.155902 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:33.157711 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:33.221816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62b12-1ce5-4cc0-8356-22d33f2984bd admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:33.226172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dbf11-8f4f-4088-b664-4bf02dbf4bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:33.226782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dbf11-8f4f-4088-b664-4bf02dbf4bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.227062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dbf11-8f4f-4088-b664-4bf02dbf4bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.227338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dbf11-8f4f-4088-b664-4bf02dbf4bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.237227 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dbf11-8f4f-4088-b664-4bf02dbf4bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:33.238677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4dbf11-8f4f-4088-b664-4bf02dbf4bc6 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:33.248479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1239/2494] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:33.530556 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:33.532016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:33.544820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7220d-cfd6-42c0-8ade-41942713b970 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:33.550279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:33.551192 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.552086 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.552373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] PATH_INFO: `/v3/projects/0b86d84d00104cbaaf6c2a5a750d4523` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.553658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b86d84d00104cbaaf6c2a5a750d4523)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:33.555563 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:33.605983 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b86d84d00104cbaaf6c2a5a750d4523', 'request_id': 'req-a2d66b11-60bf-466a-bf96-9e2b0594e479'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.612366 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b86d84d00104cbaaf6c2a5a750d4523', 'request_id': 'req-a2d66b11-60bf-466a-bf96-9e2b0594e479'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.619031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b86d84d00104cbaaf6c2a5a750d4523', 'request_id': 'req-a2d66b11-60bf-466a-bf96-9e2b0594e479'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.634289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] The token cache is being invalidate because project 0b86d84d00104cbaaf6c2a5a750d4523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:33.634582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.635206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a2d66b11-60bf-466a-bf96-9e2b0594e479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:33.636762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1256/2495] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:33 2022] DELETE /identity/v3/projects/0b86d84d00104cbaaf6c2a5a750d4523 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:33.643261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b2c6-53f4-4058-af5a-364693c6852f None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.643678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b2c6-53f4-4058-af5a-364693c6852f None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.644102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b2c6-53f4-4058-af5a-364693c6852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.665993 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-ba33b2c6-53f4-4058-af5a-364693c6852f None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:33.667054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ba33b2c6-53f4-4058-af5a-364693c6852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:33.730290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1240/2496] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:33.738408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322e91-49f2-4d73-a68f-25be415ddaca None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.738702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322e91-49f2-4d73-a68f-25be415ddaca None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.738979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322e91-49f2-4d73-a68f-25be415ddaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.759989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2d322e91-49f2-4d73-a68f-25be415ddaca None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:33.761244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2d322e91-49f2-4d73-a68f-25be415ddaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:33.769571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1257/2497] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:33.774630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33b2c6-53f4-4058-af5a-364693c6852f None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:33.787398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33b2c6-53f4-4058-af5a-364693c6852f None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:33.792860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:33.793512 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.793763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.794028 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.794665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:58:33.794966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:33.796564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:33.812969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1241/2498] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:58:33.818135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322e91-49f2-4d73-a68f-25be415ddaca None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:33.833183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322e91-49f2-4d73-a68f-25be415ddaca None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:33.841278 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:33.841871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.842151 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.842406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.843026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:33.845065 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:33.876416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1258/2499] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:33 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:33.880708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:33.890789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b080f5c-ee71-430c-b12a-18fb65dd0500 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:33.940805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:33.955046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:33.955749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:33.956022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:33.956289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:33.956926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:33.958966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:33.981810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1242/2500] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:33 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:33.986003 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:33.996663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9249a7b-001d-42c3-babe-6a416c3f6b09 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.002736 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.003405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.003682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.003950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.004623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.006254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.016725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1259/2501] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:34.020939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.031294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4249fb6-3c17-47fa-b739-0d67f3a06cc3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.037603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3ea49-d285-448d-a96c-23a43a063feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.038198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ea49-d285-448d-a96c-23a43a063feb admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.038475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ea49-d285-448d-a96c-23a43a063feb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.038742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3ea49-d285-448d-a96c-23a43a063feb admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.039378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3ea49-d285-448d-a96c-23a43a063feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.040999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3ea49-d285-448d-a96c-23a43a063feb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.052722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1243/2502] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:58:34.056862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.067508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a364c-3093-4871-9ef3-3c15475d724f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.072741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.073434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.073711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.073981 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] PATH_INFO: `/v3/projects/6874eb5de11843e09aec938b27f01c48/users/e22d70216fe644798e19b907eb707172/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.089236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6874eb5de11843e09aec938b27f01c48, user_id=e22d70216fe644798e19b907eb707172, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.091881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.102201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:34.108998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1260/2503] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:34 2022] PUT /identity/v3/projects/6874eb5de11843e09aec938b27f01c48/users/e22d70216fe644798e19b907eb707172/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:34.119821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a5cb-72f7-46b4-8c15-473b8ae55e14 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.120108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a5cb-72f7-46b4-8c15-473b8ae55e14 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.120388 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5a5cb-72f7-46b4-8c15-473b8ae55e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.151080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-11e5a5cb-72f7-46b4-8c15-473b8ae55e14 None None] MFA Rules not processed for user `e22d70216fe644798e19b907eb707172`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:34.152285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-11e5a5cb-72f7-46b4-8c15-473b8ae55e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:34.219215 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1244/2504] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:34.224478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.291883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066f75-0cb5-4b69-94e9-23f06bb30b2a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.297127 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.297718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.298089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.298595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.299266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.301203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.334448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1261/2505] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:34 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:34.339116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a5cb-72f7-46b4-8c15-473b8ae55e14 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.353320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5a5cb-72f7-46b4-8c15-473b8ae55e14 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.414144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.414763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.415046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.415321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.415963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.417956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.443809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1245/2506] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:34 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:34.448627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.463887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6308ef-20cb-4a4b-920f-81a31c9051d7 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.471422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.471957 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.472237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.472508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.473181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.474779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.485717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1262/2507] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:34.490150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.500438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb96fa-121a-4262-9e34-a5765e4963b3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.505403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.506062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.506340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.506614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] PATH_INFO: `/v3/projects/596b87f34afa4d7a90a3e1b6e6483284/users/8f96ed00e0634e22a887a050897b2b82/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.521487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=596b87f34afa4d7a90a3e1b6e6483284, user_id=8f96ed00e0634e22a887a050897b2b82, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.524163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.538891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1246/2508] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:34 2022] PUT /identity/v3/projects/596b87f34afa4d7a90a3e1b6e6483284/users/8f96ed00e0634e22a887a050897b2b82/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:34.543234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.553676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e533333-350e-4efd-b8fe-0d76a20bb291 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.611878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec3f3b-08de-448a-b8c2-40ab2afffac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.612480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec3f3b-08de-448a-b8c2-40ab2afffac4 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.612756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec3f3b-08de-448a-b8c2-40ab2afffac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.613043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec3f3b-08de-448a-b8c2-40ab2afffac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.613680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec3f3b-08de-448a-b8c2-40ab2afffac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.615266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec3f3b-08de-448a-b8c2-40ab2afffac4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.625092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1263/2509] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:34.630174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.644816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49289ad5-175a-4d8c-acf8-21049a10bd8e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.649810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.650475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.650753 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.651022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] PATH_INFO: `/v3/projects/596b87f34afa4d7a90a3e1b6e6483284/users/8f96ed00e0634e22a887a050897b2b82/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.653039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=596b87f34afa4d7a90a3e1b6e6483284, user_id=8f96ed00e0634e22a887a050897b2b82, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.655704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.666172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1247/2510] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:34 2022] PUT /identity/v3/projects/596b87f34afa4d7a90a3e1b6e6483284/users/8f96ed00e0634e22a887a050897b2b82/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:34.678218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e342c-b62b-4dd2-b399-b9ee0ead7af4 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.678505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e342c-b62b-4dd2-b399-b9ee0ead7af4 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.678831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e342c-b62b-4dd2-b399-b9ee0ead7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.710706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8c0e342c-b62b-4dd2-b399-b9ee0ead7af4 None None] MFA Rules not processed for user `8f96ed00e0634e22a887a050897b2b82`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:34.711912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8c0e342c-b62b-4dd2-b399-b9ee0ead7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:34.774753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:34.786857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1264/2511] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:34 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:58:34.797556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:34.799692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:34.810602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:34.888953 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0b7aa-880d-4f2b-bc3c-3d4356ec9e2a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:34.894061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:34.894691 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:34.894932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:34.895201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:34.905234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:34.906703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:34.917192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1248/2512] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:35.011143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e342c-b62b-4dd2-b399-b9ee0ead7af4 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:35.021381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e342c-b62b-4dd2-b399-b9ee0ead7af4 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:35.025548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ecec-49fa-42fa-be86-13bd4b43dce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:35.026106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ecec-49fa-42fa-be86-13bd4b43dce0 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:35.026384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ecec-49fa-42fa-be86-13bd4b43dce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:35.026657 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ecec-49fa-42fa-be86-13bd4b43dce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:35.083859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ecec-49fa-42fa-be86-13bd4b43dce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:35.085438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ecec-49fa-42fa-be86-13bd4b43dce0 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:35.094797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1265/2513] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:35 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:39.264758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:39.331620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2b774-6e65-40d0-9cd2-d3fd198f6478 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:39.338911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:39.339863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:39.340206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:39.340529 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] PATH_INFO: `/v3/users/e22d70216fe644798e19b907eb707172` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:39.342394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22d70216fe644798e19b907eb707172)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:39.345151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:39.402344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22d70216fe644798e19b907eb707172'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:39.402983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22d70216fe644798e19b907eb707172'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:39.412095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22d70216fe644798e19b907eb707172'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:39.412703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22d70216fe644798e19b907eb707172'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:39.424329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22d70216fe644798e19b907eb707172'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:39.436116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1249/2514] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:39 2022] DELETE /identity/v3/users/e22d70216fe644798e19b907eb707172 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:39.440822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:39.441390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:39.441500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:39.461398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:39.462613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:39.530639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1266/2515] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:58:39.541069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:39.542586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:39.554113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:39.611707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ac2e-ef03-4d99-9560-88c003d40809 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:39.616259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:39.616885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:39.617217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:39.617491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:39.626863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:39.628545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:39.638367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1250/2516] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:39.940502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:39.942301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:39.954843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8fc16-182f-46ec-afe5-ce8b137bd9e3 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:39.960727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:39.961516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:39.961802 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:39.962077 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] PATH_INFO: `/v3/projects/6874eb5de11843e09aec938b27f01c48` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:39.963357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6874eb5de11843e09aec938b27f01c48)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:39.965334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:40.014673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6874eb5de11843e09aec938b27f01c48', 'request_id': 'req-f4f8e711-e96c-484a-8c07-80cc0c084a3a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.021244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6874eb5de11843e09aec938b27f01c48', 'request_id': 'req-f4f8e711-e96c-484a-8c07-80cc0c084a3a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.026809 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6874eb5de11843e09aec938b27f01c48', 'request_id': 'req-f4f8e711-e96c-484a-8c07-80cc0c084a3a'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.041277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] The token cache is being invalidate because project 6874eb5de11843e09aec938b27f01c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:40.041569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.042271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.043896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1267/2517] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:39 2022] DELETE /identity/v3/projects/6874eb5de11843e09aec938b27f01c48 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:40.049793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:40.059870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0b4c4-4d6b-4ee7-bdbd-c100e8dfbe2d service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:40.119932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:40.120591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:40.120867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:40.121181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] PATH_INFO: `/v3/users/8f96ed00e0634e22a887a050897b2b82` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:40.122332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f96ed00e0634e22a887a050897b2b82)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:40.124278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:40.174255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f96ed00e0634e22a887a050897b2b82'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.175064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f96ed00e0634e22a887a050897b2b82'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.183577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f96ed00e0634e22a887a050897b2b82'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.184272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f96ed00e0634e22a887a050897b2b82'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.196552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-de71785a-062b-4fd6-a389-a307a9ea04fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f96ed00e0634e22a887a050897b2b82'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.208513 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1251/2518] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:40 2022] DELETE /identity/v3/users/8f96ed00e0634e22a887a050897b2b82 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:40.504402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:40.506511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:40.520749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e711-e96c-484a-8c07-80cc0c084a3a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:40.535660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:40.585908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:40.586553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:40.586837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:40.587119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] PATH_INFO: `/v3/projects/596b87f34afa4d7a90a3e1b6e6483284` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:40.588323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596b87f34afa4d7a90a3e1b6e6483284)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:40.590327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:40.647739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596b87f34afa4d7a90a3e1b6e6483284', 'request_id': 'req-ed58bc61-4b27-4647-b6c6-7a366ca77183'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.654139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596b87f34afa4d7a90a3e1b6e6483284', 'request_id': 'req-ed58bc61-4b27-4647-b6c6-7a366ca77183'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.660842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596b87f34afa4d7a90a3e1b6e6483284', 'request_id': 'req-ed58bc61-4b27-4647-b6c6-7a366ca77183'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.679529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] The token cache is being invalidate because project 596b87f34afa4d7a90a3e1b6e6483284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:40.679766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.680793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ed58bc61-4b27-4647-b6c6-7a366ca77183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:40.683263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1268/2519] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:40 2022] DELETE /identity/v3/projects/596b87f34afa4d7a90a3e1b6e6483284 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:40.689780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc395-470f-431e-87a6-0f98579b3633 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:40.690302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc395-470f-431e-87a6-0f98579b3633 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:40.690302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cc395-470f-431e-87a6-0f98579b3633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:40.713797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-886cc395-470f-431e-87a6-0f98579b3633 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:40.715004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-886cc395-470f-431e-87a6-0f98579b3633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:40.743908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:40.783410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1252/2520] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:40.791540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0db9-ddf4-4232-9a33-d6ccfb80a523 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:40.791825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0db9-ddf4-4232-9a33-d6ccfb80a523 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:40.792076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f0db9-ddf4-4232-9a33-d6ccfb80a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:40.812831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-642f0db9-ddf4-4232-9a33-d6ccfb80a523 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:40.814066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-642f0db9-ddf4-4232-9a33-d6ccfb80a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:40.823675 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1269/2521] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:40.827999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc395-470f-431e-87a6-0f98579b3633 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:40.838218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cc395-470f-431e-87a6-0f98579b3633 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:40.843198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:40.843794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:40.844069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:40.844335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:40.845005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:58:40.845306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:40.847249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:40.858692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1253/2522] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:58:40.863153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0db9-ddf4-4232-9a33-d6ccfb80a523 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:40.873425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f0db9-ddf4-4232-9a33-d6ccfb80a523 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:40.879729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:40.880336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:40.880618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:40.880877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:40.881541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:40.883475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:40.913380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1270/2523] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:40 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:58:40.917729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:40.927674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c1f5-c306-4d35-befd-2d20e756501f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:40.995950 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:40.996690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:40.997115 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:40.997433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:40.998225 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.001446 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.025836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1254/2524] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:40 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:41.030085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.041205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1ae2-b035-42b4-bbd8-792157dadfac admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.046912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.047519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.047828 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.048106 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.048742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.050432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.061110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1271/2525] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:41.065444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.077535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4001f69-f1ba-4a7d-8e50-90f77a4b9481 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.083414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3d492-415a-4483-a5b1-5ef0334a22ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.084075 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3d492-415a-4483-a5b1-5ef0334a22ae admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.084359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3d492-415a-4483-a5b1-5ef0334a22ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.084630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3d492-415a-4483-a5b1-5ef0334a22ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.085307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3d492-415a-4483-a5b1-5ef0334a22ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.086932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3d492-415a-4483-a5b1-5ef0334a22ae admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.098202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1255/2526] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:41.102433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.112618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398378cc-d2ab-4682-818f-a7d5c4b4048d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.118436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.119104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.119386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.119663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] PATH_INFO: `/v3/projects/7dd141f4abb7434f84ad17b0aea91e9b/users/f01367741eda48909cfbf0583ab2d05d/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.136004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd141f4abb7434f84ad17b0aea91e9b, user_id=f01367741eda48909cfbf0583ab2d05d, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.138727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.152655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1272/2527] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:41 2022] PUT /identity/v3/projects/7dd141f4abb7434f84ad17b0aea91e9b/users/f01367741eda48909cfbf0583ab2d05d/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:58:41.164574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b8ae-6d6d-40cf-8081-ee8dcc610387 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.164688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b8ae-6d6d-40cf-8081-ee8dcc610387 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.164949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337b8ae-6d6d-40cf-8081-ee8dcc610387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.194450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c337b8ae-6d6d-40cf-8081-ee8dcc610387 None None] MFA Rules not processed for user `f01367741eda48909cfbf0583ab2d05d`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:41.195651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c337b8ae-6d6d-40cf-8081-ee8dcc610387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:41.265359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1256/2528] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:41.270043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.321896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:41.343395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3ae1-4bc1-47e6-a794-4d10d25d1bf9 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.349382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.350031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.350316 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.350579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.351231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.353221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.383052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1273/2529] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:41 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:41.387825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337b8ae-6d6d-40cf-8081-ee8dcc610387 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.402271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337b8ae-6d6d-40cf-8081-ee8dcc610387 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.429318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:41.462876 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.463479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.463758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.464023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.464659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.466636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.490333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1257/2530] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:41 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:41.494494 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.505346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb274779-965d-4047-bb93-fd79a6a1b83e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.510827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.511443 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.511726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.512001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.512643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.514306 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.525238 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1274/2531] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:41.529451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.540498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff2acf-1251-4bc5-b7f7-bd2c25522bd5 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.546321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.547005 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.547283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.547558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] PATH_INFO: `/v3/projects/43e2cd8ef1b94b5a94e32402e32eb5e4/users/74422ff02d3e42d4b560406dd39c2eeb/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.563138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e2cd8ef1b94b5a94e32402e32eb5e4, user_id=74422ff02d3e42d4b560406dd39c2eeb, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.565901 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.581678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1258/2532] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:41 2022] PUT /identity/v3/projects/43e2cd8ef1b94b5a94e32402e32eb5e4/users/74422ff02d3e42d4b560406dd39c2eeb/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:41.585793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.596517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa8746-bae5-4102-b191-9fa70cc7d025 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.653591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a078bc-34ee-4947-b585-4636854476cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.654197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a078bc-34ee-4947-b585-4636854476cb admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.654488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a078bc-34ee-4947-b585-4636854476cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.654756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a078bc-34ee-4947-b585-4636854476cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.655420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a078bc-34ee-4947-b585-4636854476cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.657029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a078bc-34ee-4947-b585-4636854476cb admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.667397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1275/2533] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:41.672332 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.688014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3932f7-a4b0-4394-a049-799fe1cac17a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.694979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.695629 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.695908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.696168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] PATH_INFO: `/v3/projects/43e2cd8ef1b94b5a94e32402e32eb5e4/users/74422ff02d3e42d4b560406dd39c2eeb/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.698383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e2cd8ef1b94b5a94e32402e32eb5e4, user_id=74422ff02d3e42d4b560406dd39c2eeb, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.701093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.711677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1259/2534] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:41 2022] PUT /identity/v3/projects/43e2cd8ef1b94b5a94e32402e32eb5e4/users/74422ff02d3e42d4b560406dd39c2eeb/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:41.722688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec517-2161-42ea-98b6-9e8cb6487c5f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.722996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec517-2161-42ea-98b6-9e8cb6487c5f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.723275 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ec517-2161-42ea-98b6-9e8cb6487c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.753627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-de5ec517-2161-42ea-98b6-9e8cb6487c5f None None] MFA Rules not processed for user `74422ff02d3e42d4b560406dd39c2eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:41.754943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-de5ec517-2161-42ea-98b6-9e8cb6487c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:41.833085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1276/2535] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:41.844949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:41.847453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:41.917848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60442f-33d9-43e2-8141-a9027008bb64 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:41.921939 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:41.922546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:41.922833 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:41.923117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:41.932400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:41.933887 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:41.943792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1260/2536] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:42.032028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ec517-2161-42ea-98b6-9e8cb6487c5f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:42.042864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ec517-2161-42ea-98b6-9e8cb6487c5f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:42.047002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c0196-8e6f-4a9e-8dde-06dd8de76d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:42.047609 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c0196-8e6f-4a9e-8dde-06dd8de76d0d service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:42.047888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c0196-8e6f-4a9e-8dde-06dd8de76d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:42.048157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c0196-8e6f-4a9e-8dde-06dd8de76d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:42.082498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:42.119395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c0196-8e6f-4a9e-8dde-06dd8de76d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:42.120784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c0196-8e6f-4a9e-8dde-06dd8de76d0d service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:42.129953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1277/2537] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:47.040202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:47.114769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde71bf-623e-4298-813b-ae76d4a7ef11 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:47.119816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:47.120453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:47.120730 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:47.121032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] PATH_INFO: `/v3/users/f01367741eda48909cfbf0583ab2d05d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:47.122174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01367741eda48909cfbf0583ab2d05d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:47.124126 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:47.147662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:47.178322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01367741eda48909cfbf0583ab2d05d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.178984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01367741eda48909cfbf0583ab2d05d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.188612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01367741eda48909cfbf0583ab2d05d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.189389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01367741eda48909cfbf0583ab2d05d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.202333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01367741eda48909cfbf0583ab2d05d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.215709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1261/2538] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:47 2022] DELETE /identity/v3/users/f01367741eda48909cfbf0583ab2d05d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:47.220501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:47.221409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:47.221409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:47.242092 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:47.243337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:47.305644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1278/2539] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:47.315948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:47.317631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:47.379767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80549-4511-44ca-acce-6dc83564ddcd admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:47.384128 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:47.384734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:47.385041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:47.385316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:47.396340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:47.398374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:47.408428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1262/2540] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:47.691267 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:47.695851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:47.707973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06128b19-3657-4ff7-a4c7-e08991d53d41 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:47.717628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:47.718181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:47.718469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:47.718883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] PATH_INFO: `/v3/projects/7dd141f4abb7434f84ad17b0aea91e9b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:47.720149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd141f4abb7434f84ad17b0aea91e9b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:47.722972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:47.776933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd141f4abb7434f84ad17b0aea91e9b', 'request_id': 'req-f195ad37-72af-4e39-a43c-fe386c6bd552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.783891 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd141f4abb7434f84ad17b0aea91e9b', 'request_id': 'req-f195ad37-72af-4e39-a43c-fe386c6bd552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.790027 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd141f4abb7434f84ad17b0aea91e9b', 'request_id': 'req-f195ad37-72af-4e39-a43c-fe386c6bd552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.804423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] The token cache is being invalidate because project 7dd141f4abb7434f84ad17b0aea91e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:47.804707 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.805356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.806936 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1279/2541] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:47 2022] DELETE /identity/v3/projects/7dd141f4abb7434f84ad17b0aea91e9b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:47.810890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:47.820938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70719aa4-1696-4c18-a857-497f80d9f855 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:47.879920 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:47.880574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:47.880852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:47.881160 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] PATH_INFO: `/v3/users/74422ff02d3e42d4b560406dd39c2eeb` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:47.882370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74422ff02d3e42d4b560406dd39c2eeb)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:47.884353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:47.932266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:47.934213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74422ff02d3e42d4b560406dd39c2eeb'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.934914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74422ff02d3e42d4b560406dd39c2eeb'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.945100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74422ff02d3e42d4b560406dd39c2eeb'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.945847 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74422ff02d3e42d4b560406dd39c2eeb'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.958209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94ac23aa-2b24-4899-8841-ba8603da5cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74422ff02d3e42d4b560406dd39c2eeb'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:47.971210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1263/2542] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:47 2022] DELETE /identity/v3/users/74422ff02d3e42d4b560406dd39c2eeb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:48.274107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:48.275844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:48.291737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195ad37-72af-4e39-a43c-fe386c6bd552 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:48.349529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:48.350091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.350368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.350738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] PATH_INFO: `/v3/projects/43e2cd8ef1b94b5a94e32402e32eb5e4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.351912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e2cd8ef1b94b5a94e32402e32eb5e4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:48.354969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:48.357082 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:48.410360 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e2cd8ef1b94b5a94e32402e32eb5e4', 'request_id': 'req-cdffa671-9aad-4329-921d-b54eedc3b777'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:48.416668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e2cd8ef1b94b5a94e32402e32eb5e4', 'request_id': 'req-cdffa671-9aad-4329-921d-b54eedc3b777'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:48.422433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e2cd8ef1b94b5a94e32402e32eb5e4', 'request_id': 'req-cdffa671-9aad-4329-921d-b54eedc3b777'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:48.437517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] The token cache is being invalidate because project 43e2cd8ef1b94b5a94e32402e32eb5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:48.437836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:48.438511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cdffa671-9aad-4329-921d-b54eedc3b777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:48.440060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1280/2543] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:48 2022] DELETE /identity/v3/projects/43e2cd8ef1b94b5a94e32402e32eb5e4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:48.445420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcb7f2-bd89-4bd6-9645-5df9afb54d37 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.445968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcb7f2-bd89-4bd6-9645-5df9afb54d37 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.445968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcb7f2-bd89-4bd6-9645-5df9afb54d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.475587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c0fcb7f2-bd89-4bd6-9645-5df9afb54d37 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:48.477431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c0fcb7f2-bd89-4bd6-9645-5df9afb54d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:48.552667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1264/2544] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:58:48.561111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cf44f-ca75-461d-9277-5c8bfc8deda2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.561397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cf44f-ca75-461d-9277-5c8bfc8deda2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.561672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cf44f-ca75-461d-9277-5c8bfc8deda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.583269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-944cf44f-ca75-461d-9277-5c8bfc8deda2 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:48.584512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-944cf44f-ca75-461d-9277-5c8bfc8deda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:48.593862 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1281/2545] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:48.598536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcb7f2-bd89-4bd6-9645-5df9afb54d37 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:48.609247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcb7f2-bd89-4bd6-9645-5df9afb54d37 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:48.613956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:48.614596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.614878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.615148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.615805 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:58:48.616101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:48.618035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:48.633788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1265/2546] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:58:48.638402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cf44f-ca75-461d-9277-5c8bfc8deda2 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:48.648483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cf44f-ca75-461d-9277-5c8bfc8deda2 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:48.654263 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:48.654885 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.655166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.655472 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.656113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:48.658139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:48.689190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1282/2547] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:48 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:48.693608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:48.704581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013f1bb-0f4b-4278-a101-4057316432be admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:48.763014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:48.763628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.763918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.764190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.764841 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:48.766838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:48.791489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1266/2548] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:48 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:48.797399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:48.808097 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f9dd2-820b-4077-bb31-339fe222302e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:48.813217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:48.813819 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.814102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.814372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.815015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:48.816624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:48.827210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1283/2549] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:48.831326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:48.841538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d62df-dbf4-4cb7-b2d9-e9799317c037 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:48.846912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927f297-1e7a-4bbd-a3a7-c91054f727b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:48.847567 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927f297-1e7a-4bbd-a3a7-c91054f727b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.847846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927f297-1e7a-4bbd-a3a7-c91054f727b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.848118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927f297-1e7a-4bbd-a3a7-c91054f727b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.848756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927f297-1e7a-4bbd-a3a7-c91054f727b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:48.850376 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927f297-1e7a-4bbd-a3a7-c91054f727b8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:48.861268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1267/2550] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:48.865711 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:48.876239 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46a65-631b-4d4a-8bad-1432a5d4e93d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:48.881697 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:48.882385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.882663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.882933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] PATH_INFO: `/v3/projects/a44881e2e61d450f909e2ae33c7fc72b/users/1d02233acc9f44b79cc952d37c4812aa/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.897877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44881e2e61d450f909e2ae33c7fc72b, user_id=1d02233acc9f44b79cc952d37c4812aa, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:48.900588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:48.915665 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1284/2551] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:48 2022] PUT /identity/v3/projects/a44881e2e61d450f909e2ae33c7fc72b/users/1d02233acc9f44b79cc952d37c4812aa/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:48.927092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605c0a-6d3e-4189-b377-e2cc2cc5f442 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:48.927382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605c0a-6d3e-4189-b377-e2cc2cc5f442 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:48.927650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605c0a-6d3e-4189-b377-e2cc2cc5f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:48.955338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-12605c0a-6d3e-4189-b377-e2cc2cc5f442 None None] MFA Rules not processed for user `1d02233acc9f44b79cc952d37c4812aa`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:48.956537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-12605c0a-6d3e-4189-b377-e2cc2cc5f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:48.975214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:49.025831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1268/2552] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:49.030696 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:49.097449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5160-0b26-4d8f-89aa-91c2a16d8118 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:49.103179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:49.103793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.104073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.104346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.105030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:49.107026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:49.138531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1285/2553] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:49 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:49.142995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12605c0a-6d3e-4189-b377-e2cc2cc5f442 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:49.154459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12605c0a-6d3e-4189-b377-e2cc2cc5f442 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:49.211403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:49.212013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.212292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.212560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.213220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:49.215156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:49.239641 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1269/2554] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:49 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:49.245350 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:49.256603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3385a-7723-471b-a210-2555c2d0230a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:49.261629 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:49.262241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.262518 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.262788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.263423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:49.265050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:49.270395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:49.276177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1286/2555] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:49.280614 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:49.292086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a7f1-4de1-4ece-a3ba-c60ba55212e1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:49.297197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:49.297852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.298161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.298451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] PATH_INFO: `/v3/projects/e728e1ca57db4e1f8ee83c79ace9437c/users/34ecab669c224953a90f3cb32a099d07/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.314893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e728e1ca57db4e1f8ee83c79ace9437c, user_id=34ecab669c224953a90f3cb32a099d07, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:49.317676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:49.333472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1270/2556] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:49 2022] PUT /identity/v3/projects/e728e1ca57db4e1f8ee83c79ace9437c/users/34ecab669c224953a90f3cb32a099d07/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:49.337593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:49.348229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1ec53-3e91-46a2-8175-6c4e6a0e1d46 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:49.408224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310747ef-2c29-4898-8602-a0542838b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:49.408780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310747ef-2c29-4898-8602-a0542838b619 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.409085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310747ef-2c29-4898-8602-a0542838b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.409355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310747ef-2c29-4898-8602-a0542838b619 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.409990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310747ef-2c29-4898-8602-a0542838b619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:49.411590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310747ef-2c29-4898-8602-a0542838b619 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:49.421920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1287/2557] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:49.426251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:49.437063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da501122-d908-4afa-8298-0174b1bf152e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:49.442082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:49.442736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.443023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.443296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] PATH_INFO: `/v3/projects/e728e1ca57db4e1f8ee83c79ace9437c/users/34ecab669c224953a90f3cb32a099d07/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.445536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e728e1ca57db4e1f8ee83c79ace9437c, user_id=34ecab669c224953a90f3cb32a099d07, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:49.448380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:49.459414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1271/2558] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:49 2022] PUT /identity/v3/projects/e728e1ca57db4e1f8ee83c79ace9437c/users/34ecab669c224953a90f3cb32a099d07/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:49.470034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f2a8-a609-43b9-85ad-8636080956fa None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.470326 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f2a8-a609-43b9-85ad-8636080956fa None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.470955 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f2a8-a609-43b9-85ad-8636080956fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.501026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7143f2a8-a609-43b9-85ad-8636080956fa None None] MFA Rules not processed for user `34ecab669c224953a90f3cb32a099d07`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:49.502247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7143f2a8-a609-43b9-85ad-8636080956fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:49.571470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1288/2559] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:49.582604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:49.584317 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:49.644463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b6d1f-4760-440e-8f5b-36d7137cf7aa admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:49.649382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71715b35-030e-4e9e-a46e-096532f2cbc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:49.649992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715b35-030e-4e9e-a46e-096532f2cbc6 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:49.650272 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715b35-030e-4e9e-a46e-096532f2cbc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:49.650543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715b35-030e-4e9e-a46e-096532f2cbc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:49.684439 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:49.718169 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71715b35-030e-4e9e-a46e-096532f2cbc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:49.719605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71715b35-030e-4e9e-a46e-096532f2cbc6 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:49.728932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1272/2560] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:52.324475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143f2a8-a609-43b9-85ad-8636080956fa None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:52.399984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143f2a8-a609-43b9-85ad-8636080956fa None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:52.405078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:52.405723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:52.406004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:52.406273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] PATH_INFO: `/v3/users/1d02233acc9f44b79cc952d37c4812aa` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:52.407460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d02233acc9f44b79cc952d37c4812aa)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:52.409464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:52.434104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:52.464329 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d02233acc9f44b79cc952d37c4812aa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:52.465051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d02233acc9f44b79cc952d37c4812aa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:52.472163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d02233acc9f44b79cc952d37c4812aa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:52.480946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d02233acc9f44b79cc952d37c4812aa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:52.481608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d02233acc9f44b79cc952d37c4812aa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:52.500037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1289/2561] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:52 2022] DELETE /identity/v3/users/1d02233acc9f44b79cc952d37c4812aa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:52.504659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:52.505187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:52.505292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:52.525394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:52.526619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:52.591472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1273/2562] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:52.601980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:52.603559 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:52.668375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491976b-dafe-4517-ae9e-210d640be238 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:52.674342 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:52.675235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:52.675586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:52.675952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:52.687662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:52.689095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:52.699173 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1290/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:52.987649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:52.989230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:53.004051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cc5c9-7748-425f-b8fd-d4917552c52b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:53.009395 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:53.010069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:53.010331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:53.010633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] PATH_INFO: `/v3/projects/a44881e2e61d450f909e2ae33c7fc72b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:53.011812 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44881e2e61d450f909e2ae33c7fc72b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:53.013762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:53.063815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44881e2e61d450f909e2ae33c7fc72b', 'request_id': 'req-e66c89db-d34a-458e-adcc-80e261e08017'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.073281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44881e2e61d450f909e2ae33c7fc72b', 'request_id': 'req-e66c89db-d34a-458e-adcc-80e261e08017'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.079618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44881e2e61d450f909e2ae33c7fc72b', 'request_id': 'req-e66c89db-d34a-458e-adcc-80e261e08017'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.091161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] The token cache is being invalidate because project a44881e2e61d450f909e2ae33c7fc72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:53.091454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.092111 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.093735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1274/2564] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:52 2022] DELETE /identity/v3/projects/a44881e2e61d450f909e2ae33c7fc72b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:58:53.098230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:53.108264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e28af-fe70-4d8b-b6d5-02135b445fb7 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:53.168093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:53.168734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:53.169042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:53.169317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] PATH_INFO: `/v3/users/34ecab669c224953a90f3cb32a099d07` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:53.170569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ecab669c224953a90f3cb32a099d07)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:53.173030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:53.223634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:53.225258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ecab669c224953a90f3cb32a099d07'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.225921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ecab669c224953a90f3cb32a099d07'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.234524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ecab669c224953a90f3cb32a099d07'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.244500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ecab669c224953a90f3cb32a099d07'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.245207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-4e413f0a-ce4d-4e63-af78-8556a8212e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ecab669c224953a90f3cb32a099d07'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.264114 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1291/2565] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:58:53 2022] DELETE /identity/v3/users/34ecab669c224953a90f3cb32a099d07 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:53.544677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:53.546189 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:53.561373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c89db-d34a-458e-adcc-80e261e08017 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:53.608068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:53.622644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:53.623601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:53.623884 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:53.624204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] PATH_INFO: `/v3/projects/e728e1ca57db4e1f8ee83c79ace9437c` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:53.625453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e728e1ca57db4e1f8ee83c79ace9437c)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:53.627434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:53.676659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e728e1ca57db4e1f8ee83c79ace9437c', 'request_id': 'req-a0ab54d5-dde5-435d-af50-693de674511b'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.685250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e728e1ca57db4e1f8ee83c79ace9437c', 'request_id': 'req-a0ab54d5-dde5-435d-af50-693de674511b'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.690932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e728e1ca57db4e1f8ee83c79ace9437c', 'request_id': 'req-a0ab54d5-dde5-435d-af50-693de674511b'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.702147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] The token cache is being invalidate because project e728e1ca57db4e1f8ee83c79ace9437c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:58:53.702448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.703078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a0ab54d5-dde5-435d-af50-693de674511b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:58:53.704566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1275/2566] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:58:53 2022] DELETE /identity/v3/projects/e728e1ca57db4e1f8ee83c79ace9437c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:53.709741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e3fb-416e-4f28-a565-157df1e70d15 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:53.710241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e3fb-416e-4f28-a565-157df1e70d15 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:53.710345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e3fb-416e-4f28-a565-157df1e70d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:53.732264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a5a6e3fb-416e-4f28-a565-157df1e70d15 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:53.733507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a5a6e3fb-416e-4f28-a565-157df1e70d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:53.795290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1292/2567] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:53.806090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088d7a-4813-45b1-9c93-400506ccd5a1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:53.806090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088d7a-4813-45b1-9c93-400506ccd5a1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:53.806392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088d7a-4813-45b1-9c93-400506ccd5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:53.826890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-82088d7a-4813-45b1-9c93-400506ccd5a1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:53.828102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-82088d7a-4813-45b1-9c93-400506ccd5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:53.836817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1276/2568] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:53.841113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e3fb-416e-4f28-a565-157df1e70d15 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:53.851260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e3fb-416e-4f28-a565-157df1e70d15 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:53.856616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:53.857298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:53.857576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:53.857846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:53.858564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:58:53.858867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:53.860547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:53.873712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1293/2569] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:58:53.878185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088d7a-4813-45b1-9c93-400506ccd5a1 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:53.887725 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088d7a-4813-45b1-9c93-400506ccd5a1 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:53.892731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:53.893392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:53.893667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:53.893971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:53.894615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:53.896591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:53.929122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1277/2570] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:53.935283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:53.946163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131dc05-270f-4742-a40f-d52d834e7af3 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.007428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.008066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.008346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.008601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.009334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.011256 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.035045 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1294/2571] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:53 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:54.038733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.049384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decea920-ddb5-4881-b59f-f7873ae55d3c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.054104 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.054694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.054974 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.055254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.056016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.057609 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.067578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1278/2572] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:54.071481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.081793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5804ae3-a363-42e3-9ab4-a70328f9ba81 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.087095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68dbe9-7954-4930-809f-d7b17bbd208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.087685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68dbe9-7954-4930-809f-d7b17bbd208c admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.087993 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68dbe9-7954-4930-809f-d7b17bbd208c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.088265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68dbe9-7954-4930-809f-d7b17bbd208c admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.088902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68dbe9-7954-4930-809f-d7b17bbd208c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.090538 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68dbe9-7954-4930-809f-d7b17bbd208c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.101832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1295/2573] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:54.106493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.121626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1083fc-1887-4355-b5ea-45959a721146 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.127112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.127811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.128093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.128370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] PATH_INFO: `/v3/projects/929b91de23b740c6872c34c5530e84af/users/3affd615ebd84ebe8952bf9650a20ff7/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.143959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929b91de23b740c6872c34c5530e84af, user_id=3affd615ebd84ebe8952bf9650a20ff7, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.146792 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.164520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1279/2574] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:54 2022] PUT /identity/v3/projects/929b91de23b740c6872c34c5530e84af/users/3affd615ebd84ebe8952bf9650a20ff7/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:54.175723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9045d-f422-4331-b758-e71a6f73d0aa None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.176109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9045d-f422-4331-b758-e71a6f73d0aa None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.176507 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9045d-f422-4331-b758-e71a6f73d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.207253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-91f9045d-f422-4331-b758-e71a6f73d0aa None None] MFA Rules not processed for user `3affd615ebd84ebe8952bf9650a20ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:54.208453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-91f9045d-f422-4331-b758-e71a6f73d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:54.226322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:54.283504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1296/2575] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:54.288620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.354327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323323bc-7cbc-4c9b-b1f3-dd69b5d11528 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.359803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.360406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.360690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.361011 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.361628 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.363541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.388052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:54.397480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1280/2576] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:54 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:54.398674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9045d-f422-4331-b758-e71a6f73d0aa None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.410246 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9045d-f422-4331-b758-e71a6f73d0aa None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.471916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.472520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.472795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.473109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.473731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.475653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.499448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1297/2577] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:54 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:58:54.503648 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.514799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c8e94-d815-4ef7-be13-a0a7d6df03c0 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.520141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.520785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.521099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.521372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.522055 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.523773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.534964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1281/2578] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:54.539166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.551882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da546c4e-88fb-401d-b939-99abb1ceacc6 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.557903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eb7e7-b795-4a00-af49-52a5ac8d6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.558530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb7e7-b795-4a00-af49-52a5ac8d6c6f admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.558791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb7e7-b795-4a00-af49-52a5ac8d6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.559055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eb7e7-b795-4a00-af49-52a5ac8d6c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.559693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eb7e7-b795-4a00-af49-52a5ac8d6c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.561336 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eb7e7-b795-4a00-af49-52a5ac8d6c6f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.572406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1298/2579] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:54.577297 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.588860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b358fb-f843-466c-b514-89b0e9a093ea admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.594537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.595195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.595822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.596090 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] PATH_INFO: `/v3/projects/a42ec86795774fa4b3e400279af52491/users/e0e977fb21074e0295df8d12fcff8119/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.612263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42ec86795774fa4b3e400279af52491, user_id=e0e977fb21074e0295df8d12fcff8119, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.614914 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.630864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1282/2580] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:54 2022] PUT /identity/v3/projects/a42ec86795774fa4b3e400279af52491/users/e0e977fb21074e0295df8d12fcff8119/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:54.641708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd350ac-b7d0-4614-b3d5-309b9b7df2f0 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.642022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd350ac-b7d0-4614-b3d5-309b9b7df2f0 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.642296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd350ac-b7d0-4614-b3d5-309b9b7df2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.671967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8bd350ac-b7d0-4614-b3d5-309b9b7df2f0 None None] MFA Rules not processed for user `e0e977fb21074e0295df8d12fcff8119`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:54.673213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8bd350ac-b7d0-4614-b3d5-309b9b7df2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:54.741112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1299/2581] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:54.745966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.810167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5869e8-fa24-46f0-899a-6b8297e28a22 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.815404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.816013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.816291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.816559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.817239 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.819205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.852494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1283/2582] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:58:54 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:54.856759 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd350ac-b7d0-4614-b3d5-309b9b7df2f0 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.868181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd350ac-b7d0-4614-b3d5-309b9b7df2f0 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.897014 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:54.933855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.934468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.934743 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.935012 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.935647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.937769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:54.963510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1300/2583] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:58:54 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:58:54.967781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:54.980436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea3670-ec68-4b7f-92c3-72dcc9560a6e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:54.986106 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:54.986773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:54.987004 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:54.987276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:54.987932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:54.989621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:55.001569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1284/2584] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:55.005935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:55.016258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a233468-ca1d-4b9e-ba41-9e8c3f2307fa admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:55.021471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:55.022130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:55.022409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:55.022680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] PATH_INFO: `/v3/projects/1531f4d02689459383079ef8e98b5b13/users/cc9950ebb3cd4611b02c44682c4488a4/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:55.041702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1531f4d02689459383079ef8e98b5b13, user_id=cc9950ebb3cd4611b02c44682c4488a4, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:55.044394 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:55.060781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1301/2585] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:55 2022] PUT /identity/v3/projects/1531f4d02689459383079ef8e98b5b13/users/cc9950ebb3cd4611b02c44682c4488a4/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:58:55.067173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:55.079006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73337fe-d25a-404c-a647-13827e5ca55c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:55.144204 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabad72-54c5-4430-b589-61cb91cb39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:55.145078 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabad72-54c5-4430-b589-61cb91cb39a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:55.145568 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabad72-54c5-4430-b589-61cb91cb39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:55.146027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabad72-54c5-4430-b589-61cb91cb39a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:55.147190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabad72-54c5-4430-b589-61cb91cb39a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:55.150121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabad72-54c5-4430-b589-61cb91cb39a8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:55.165506 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1285/2586] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:58:55.168285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:55.181110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6034fb1-4b6c-4e57-bb29-240aa69b6481 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:55.187181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:55.187850 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:55.188133 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:55.188403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] PATH_INFO: `/v3/projects/1531f4d02689459383079ef8e98b5b13/users/cc9950ebb3cd4611b02c44682c4488a4/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:55.190663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1531f4d02689459383079ef8e98b5b13, user_id=cc9950ebb3cd4611b02c44682c4488a4, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:55.193373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:55.204805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1302/2587] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:58:55 2022] PUT /identity/v3/projects/1531f4d02689459383079ef8e98b5b13/users/cc9950ebb3cd4611b02c44682c4488a4/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:58:55.216540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:55.216825 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:55.217136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:55.246651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] MFA Rules not processed for user `cc9950ebb3cd4611b02c44682c4488a4`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:58:55.247878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:55.276287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:58:55.322266 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1286/2588] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:58:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:58:55.333917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:55.335804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:55.403153 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f79c-9ac9-4f23-8021-fd15126478b5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:55.407390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:55.408000 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:55.408280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:55.408553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:55.467274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:55.468792 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:55.481602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1303/2589] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:57.042570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:57.044085 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:58:57.057450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c02617-725b-42c9-a5b6-d4714442989b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:57.060960 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:57.061563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:57.061904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:57.062177 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:57.131828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:57.133328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:57.142834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1287/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:58:57.710446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:58:57.720094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52a88a-37a8-4dd0-9ead-7159e9d7fd5a service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:58:57.725479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad0c35-9e0f-4663-921a-9b7947394b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:58:57.726087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0c35-9e0f-4663-921a-9b7947394b96 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:58:57.726347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0c35-9e0f-4663-921a-9b7947394b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:58:57.726668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0c35-9e0f-4663-921a-9b7947394b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:58:57.743588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad0c35-9e0f-4663-921a-9b7947394b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:58:57.745817 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad0c35-9e0f-4663-921a-9b7947394b96 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:58:57.758450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1304/2591] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:58:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:01.719904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:01.790941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c70e2d-2755-4b3d-a688-523104fd25a3 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:01.797141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:01.797801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:01.798080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:01.798357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] PATH_INFO: `/v3/users/3affd615ebd84ebe8952bf9650a20ff7` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:01.799693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3affd615ebd84ebe8952bf9650a20ff7)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:01.801772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:01.863384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3affd615ebd84ebe8952bf9650a20ff7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:01.864056 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3affd615ebd84ebe8952bf9650a20ff7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:01.872522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3affd615ebd84ebe8952bf9650a20ff7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:01.873202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3affd615ebd84ebe8952bf9650a20ff7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:01.878361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:01.886839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3affd615ebd84ebe8952bf9650a20ff7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:01.900558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1288/2592] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:01 2022] DELETE /identity/v3/users/3affd615ebd84ebe8952bf9650a20ff7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:01.905592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:01.906130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:01.906130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:01.926168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:01.927441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:01.941451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:01.998844 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1305/2593] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:02.011761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:02.013370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:02.072244 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c5f8-9ea1-484a-9817-0c64a6c00e1f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:02.077124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:02.077729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:02.078006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:02.078240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:02.089279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:02.090716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:02.101378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1289/2594] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:02.398812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:02.400330 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:02.412784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eeda3-1477-4540-89ff-9482ad831cb7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:02.417753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:02.418482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:02.418835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:02.419113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] PATH_INFO: `/v3/projects/929b91de23b740c6872c34c5530e84af` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:02.420268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] RBAC: Authorizing `identity:delete_project(project_id=929b91de23b740c6872c34c5530e84af)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:02.422234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:02.474680 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929b91de23b740c6872c34c5530e84af', 'request_id': 'req-8d569e70-7e98-402e-9523-cdbc639dbfad'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.481091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929b91de23b740c6872c34c5530e84af', 'request_id': 'req-8d569e70-7e98-402e-9523-cdbc639dbfad'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.486975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929b91de23b740c6872c34c5530e84af', 'request_id': 'req-8d569e70-7e98-402e-9523-cdbc639dbfad'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.502677 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] The token cache is being invalidate because project 929b91de23b740c6872c34c5530e84af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:02.502972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.503589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.505146 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1306/2595] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:02 2022] DELETE /identity/v3/projects/929b91de23b740c6872c34c5530e84af => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:02.509328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:02.519370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d2a74-1edb-44ae-8047-45ecf5a0774b service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:02.579307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:02.579941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:02.580220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:02.580492 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] PATH_INFO: `/v3/users/e0e977fb21074e0295df8d12fcff8119` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:02.581658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e977fb21074e0295df8d12fcff8119)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:02.583569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:02.632286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e977fb21074e0295df8d12fcff8119'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.633033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e977fb21074e0295df8d12fcff8119'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.642417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e977fb21074e0295df8d12fcff8119'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.643109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e977fb21074e0295df8d12fcff8119'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.656336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e977fb21074e0295df8d12fcff8119'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:02.665072 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:02.672766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1290/2596] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:02 2022] DELETE /identity/v3/users/e0e977fb21074e0295df8d12fcff8119 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:03.392098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:03.393704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:03.407476 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d569e70-7e98-402e-9523-cdbc639dbfad admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:03.468702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:03.469393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:03.469671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:03.469943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] PATH_INFO: `/v3/projects/a42ec86795774fa4b3e400279af52491` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:03.471404 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42ec86795774fa4b3e400279af52491)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:03.473377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:03.518160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:03.520642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42ec86795774fa4b3e400279af52491', 'request_id': 'req-460bdd39-db15-48a8-8a64-b34ea982cf50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.527848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42ec86795774fa4b3e400279af52491', 'request_id': 'req-460bdd39-db15-48a8-8a64-b34ea982cf50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.535897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42ec86795774fa4b3e400279af52491', 'request_id': 'req-460bdd39-db15-48a8-8a64-b34ea982cf50'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.549805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] The token cache is being invalidate because project a42ec86795774fa4b3e400279af52491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:03.550103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.550746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.552269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1307/2597] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:03 2022] DELETE /identity/v3/projects/a42ec86795774fa4b3e400279af52491 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:03.556472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:03.559557 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:03.572683 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581b56-a363-4cb7-8f89-40cbf61b8a2c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:03.643254 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:03.644036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:03.644371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:03.644693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] PATH_INFO: `/v3/users/cc9950ebb3cd4611b02c44682c4488a4` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:03.646084 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9950ebb3cd4611b02c44682c4488a4)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:03.648018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:03.701148 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9950ebb3cd4611b02c44682c4488a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.701836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9950ebb3cd4611b02c44682c4488a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.710399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9950ebb3cd4611b02c44682c4488a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.711151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9950ebb3cd4611b02c44682c4488a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.724151 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-88aded2e-7e52-46af-9bd9-83d73694244a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9950ebb3cd4611b02c44682c4488a4'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:03.736359 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1291/2598] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:03 2022] DELETE /identity/v3/users/cc9950ebb3cd4611b02c44682c4488a4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:59:04.186810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:04.188302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:04.221112 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bdd39-db15-48a8-8a64-b34ea982cf50 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:04.324010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:04.324673 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.324996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.325271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] PATH_INFO: `/v3/projects/1531f4d02689459383079ef8e98b5b13` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.326489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1531f4d02689459383079ef8e98b5b13)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:04.328512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:04.393669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1531f4d02689459383079ef8e98b5b13', 'request_id': 'req-e02d12bc-d351-4122-8beb-4dce3ab0aa38'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:04.400234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1531f4d02689459383079ef8e98b5b13', 'request_id': 'req-e02d12bc-d351-4122-8beb-4dce3ab0aa38'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:04.406939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1531f4d02689459383079ef8e98b5b13', 'request_id': 'req-e02d12bc-d351-4122-8beb-4dce3ab0aa38'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:04.425936 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] The token cache is being invalidate because project 1531f4d02689459383079ef8e98b5b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:04.426268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:04.427102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e02d12bc-d351-4122-8beb-4dce3ab0aa38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:04.428703 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1308/2599] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:04 2022] DELETE /identity/v3/projects/1531f4d02689459383079ef8e98b5b13 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:04.433879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275fdbb-35fe-481e-88d9-b29b7ff1d1eb None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.434233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275fdbb-35fe-481e-88d9-b29b7ff1d1eb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.435983 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275fdbb-35fe-481e-88d9-b29b7ff1d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.458546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7275fdbb-35fe-481e-88d9-b29b7ff1d1eb None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:04.459760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7275fdbb-35fe-481e-88d9-b29b7ff1d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:04.525564 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1292/2600] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:04.533780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902edd-82b5-4273-9d03-95d7ad79ed64 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.534458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902edd-82b5-4273-9d03-95d7ad79ed64 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.534796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05902edd-82b5-4273-9d03-95d7ad79ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.555248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-05902edd-82b5-4273-9d03-95d7ad79ed64 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:04.556489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-05902edd-82b5-4273-9d03-95d7ad79ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:04.565015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1309/2601] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:59:04.569002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275fdbb-35fe-481e-88d9-b29b7ff1d1eb None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:04.579184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275fdbb-35fe-481e-88d9-b29b7ff1d1eb None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:04.584114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:04.584745 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.585070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.585352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.586012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:04.586334 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:04.587990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:04.600501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1293/2602] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:04.605422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902edd-82b5-4273-9d03-95d7ad79ed64 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:04.614762 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05902edd-82b5-4273-9d03-95d7ad79ed64 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:04.619812 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:04.620640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.620932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.621212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.621847 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:04.623752 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:04.653346 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1310/2603] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:04 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:04.657639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:04.668405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276db162-f404-4f2c-8658-ce33bbb065a8 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:04.673057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:04.738323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:04.739142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.739678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.739882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.740719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:04.742815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:04.769251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1294/2604] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:04 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:04.773338 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:04.784351 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f9b95-22ed-4024-8bdd-45ab29fb78b9 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:04.790344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:04.790979 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.791265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.791624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.792414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:04.794135 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:04.808310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1311/2605] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:04.809962 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:04.821120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0287c3-70d6-429b-989c-b5f81ed5744f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:04.827172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9007c-429a-4e9e-90dd-c5a3e563166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:04.827404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9007c-429a-4e9e-90dd-c5a3e563166a admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.827709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9007c-429a-4e9e-90dd-c5a3e563166a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.828057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9007c-429a-4e9e-90dd-c5a3e563166a admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.828997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9007c-429a-4e9e-90dd-c5a3e563166a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:04.830838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9007c-429a-4e9e-90dd-c5a3e563166a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:04.842670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1295/2606] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:04.847307 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:04.859637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0801f6f-ae12-41c4-b5bf-c12dd61f7413 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:04.865049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:04.865727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.866009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.866288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] PATH_INFO: `/v3/projects/5f5ce1d0b5ce4b6b8402cdb8efd5fc84/users/23f0bd5419cb429e8c21bb0c05876978/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.881663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5ce1d0b5ce4b6b8402cdb8efd5fc84, user_id=23f0bd5419cb429e8c21bb0c05876978, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:04.884315 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:04.895036 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:04.900049 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1312/2607] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:04 2022] PUT /identity/v3/projects/5f5ce1d0b5ce4b6b8402cdb8efd5fc84/users/23f0bd5419cb429e8c21bb0c05876978/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:04.912264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e75ed-8e3c-420f-9afe-d1eeadd5ac28 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:04.912640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e75ed-8e3c-420f-9afe-d1eeadd5ac28 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:04.913081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e75ed-8e3c-420f-9afe-d1eeadd5ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:04.946109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-de8e75ed-8e3c-420f-9afe-d1eeadd5ac28 None None] MFA Rules not processed for user `23f0bd5419cb429e8c21bb0c05876978`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:04.947319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-de8e75ed-8e3c-420f-9afe-d1eeadd5ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:05.029261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1296/2608] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:05.040864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:05.043271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:05.112237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057ae78-8dec-4555-8443-e6c9b9127439 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:05.116780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6b2d4-4bf2-4316-a8ce-8740b0bb73ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:05.117531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b2d4-4bf2-4316-a8ce-8740b0bb73ef service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:05.117761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b2d4-4bf2-4316-a8ce-8740b0bb73ef service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:05.118055 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b2d4-4bf2-4316-a8ce-8740b0bb73ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:05.132328 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6b2d4-4bf2-4316-a8ce-8740b0bb73ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:05.134531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6b2d4-4bf2-4316-a8ce-8740b0bb73ef service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:05.146060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1313/2609] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:07.785108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e75ed-8e3c-420f-9afe-d1eeadd5ac28 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:07.857891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e75ed-8e3c-420f-9afe-d1eeadd5ac28 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:07.863180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:07.863814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:07.864093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:07.864368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] PATH_INFO: `/v3/users/23f0bd5419cb429e8c21bb0c05876978` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:07.865530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f0bd5419cb429e8c21bb0c05876978)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:07.867469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:07.883380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:07.916537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f0bd5419cb429e8c21bb0c05876978'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:07.917202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f0bd5419cb429e8c21bb0c05876978'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:07.927337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f0bd5419cb429e8c21bb0c05876978'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:07.928114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f0bd5419cb429e8c21bb0c05876978'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:07.940734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f0bd5419cb429e8c21bb0c05876978'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:07.953159 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1297/2610] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:07 2022] DELETE /identity/v3/users/23f0bd5419cb429e8c21bb0c05876978 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:07.957905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:07.958396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:07.958517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:07.978732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:07.979943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:08.041541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1314/2611] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:59:08.051574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:08.053138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:08.118762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a281-e669-4017-983a-dee0ea2de428 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:08.122391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:08.123113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:08.123436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:08.123787 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:08.133329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:08.134766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:08.147396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1298/2612] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:08.157829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:08.159419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:08.172980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c8a35-1e0e-4a0e-9827-3b410c158c83 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:08.176661 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf05e-be51-472a-9870-63b0d0d13adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:08.177314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf05e-be51-472a-9870-63b0d0d13adc service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:08.177595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf05e-be51-472a-9870-63b0d0d13adc service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:08.177864 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf05e-be51-472a-9870-63b0d0d13adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:08.179722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-359cf05e-be51-472a-9870-63b0d0d13adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:08.193048 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cf05e-be51-472a-9870-63b0d0d13adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:08.194492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cf05e-be51-472a-9870-63b0d0d13adc service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:08.205220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1315/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:08.592309 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:08.593980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:08.607500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8969-1135-4143-bc3e-4ef830ccaf42 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:08.613758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:08.614432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:08.614746 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:08.615000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] PATH_INFO: `/v3/projects/5f5ce1d0b5ce4b6b8402cdb8efd5fc84` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:08.616294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5ce1d0b5ce4b6b8402cdb8efd5fc84)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:08.618343 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:08.677886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5ce1d0b5ce4b6b8402cdb8efd5fc84', 'request_id': 'req-94571497-c2c9-4661-a378-e2c440254b39'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:08.688207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5ce1d0b5ce4b6b8402cdb8efd5fc84', 'request_id': 'req-94571497-c2c9-4661-a378-e2c440254b39'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:08.694979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5ce1d0b5ce4b6b8402cdb8efd5fc84', 'request_id': 'req-94571497-c2c9-4661-a378-e2c440254b39'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:08.708199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] The token cache is being invalidate because project 5f5ce1d0b5ce4b6b8402cdb8efd5fc84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:08.708544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:08.709318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-94571497-c2c9-4661-a378-e2c440254b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:08.711026 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1299/2614] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:08 2022] DELETE /identity/v3/projects/5f5ce1d0b5ce4b6b8402cdb8efd5fc84 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:08.715859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ea8a-0c6b-4d73-a572-a46cb74f4342 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:08.716144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ea8a-0c6b-4d73-a572-a46cb74f4342 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:08.716436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ea8a-0c6b-4d73-a572-a46cb74f4342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:08.737345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ad64ea8a-0c6b-4d73-a572-a46cb74f4342 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:08.738559 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ad64ea8a-0c6b-4d73-a572-a46cb74f4342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:08.803255 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1316/2615] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:08.870180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481abfa8-0abb-436c-870b-87d14e3c0f8a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:08.870733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481abfa8-0abb-436c-870b-87d14e3c0f8a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:08.870733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481abfa8-0abb-436c-870b-87d14e3c0f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:08.891538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-481abfa8-0abb-436c-870b-87d14e3c0f8a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:08.892737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-481abfa8-0abb-436c-870b-87d14e3c0f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:08.905705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1300/2616] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:08.910104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ea8a-0c6b-4d73-a572-a46cb74f4342 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:08.920283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ea8a-0c6b-4d73-a572-a46cb74f4342 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:08.925235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:08.925841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:08.926117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:08.926385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:08.927029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:08.927331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:08.928949 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:08.940824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1317/2617] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:08.945255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481abfa8-0abb-436c-870b-87d14e3c0f8a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:08.955129 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481abfa8-0abb-436c-870b-87d14e3c0f8a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:08.960062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:08.960668 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:08.960976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:08.961252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:08.961924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:08.963911 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:08.975804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:08.996955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1301/2618] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:08 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:09.000984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:09.011834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb14ec8-a983-44b5-ace2-e8463228dab0 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:09.026286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:09.073208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:09.073954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:09.074243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:09.074516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:09.075137 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:09.077384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:09.101484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1318/2619] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:08 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:09.105737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:09.117251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8e0f4-84f3-4994-ac12-7a8e3e2ffd7b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:09.122217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:09.122883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:09.123167 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:09.123478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:09.124166 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:09.125851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:09.136708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1302/2620] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:09.140907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:09.151448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65be0-3ae4-439a-944a-a50a0ee5d047 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:09.156353 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755cd44-7bb7-4271-b5ee-3f2980ecd03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:09.157018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755cd44-7bb7-4271-b5ee-3f2980ecd03f admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:09.157323 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755cd44-7bb7-4271-b5ee-3f2980ecd03f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:09.157644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755cd44-7bb7-4271-b5ee-3f2980ecd03f admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:09.158324 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755cd44-7bb7-4271-b5ee-3f2980ecd03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:09.160603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755cd44-7bb7-4271-b5ee-3f2980ecd03f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:09.176079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1319/2621] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:09.180206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:09.190971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe325e58-b13a-4db1-a745-26fe98394a73 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:09.196021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:09.196827 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:09.197240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:09.197581 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] PATH_INFO: `/v3/projects/73ef0595331443c7916b4a502fbf0a07/users/54e737f7d44e4b55ae01a2cccec8ae60/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:09.222642 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ef0595331443c7916b4a502fbf0a07, user_id=54e737f7d44e4b55ae01a2cccec8ae60, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:09.225553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:09.242944 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1303/2622] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:09 2022] PUT /identity/v3/projects/73ef0595331443c7916b4a502fbf0a07/users/54e737f7d44e4b55ae01a2cccec8ae60/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:09.254576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:09.254913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:09.255260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:09.296224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] MFA Rules not processed for user `54e737f7d44e4b55ae01a2cccec8ae60`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:09.297821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:09.389070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1320/2623] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:09.401482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:09.403207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:09.460604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4128e5-d6a0-4835-af98-2c954547af0a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:09.464236 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22a017e6b1d64044b4f5e3fb67cfd67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:09.464851 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:09.465230 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:09.465496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:09.474699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:09.476082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:09.485312 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1304/2624] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:11.632637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:11.634400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:11.709933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc92c6-0aae-4769-94f1-39a7fbd1f01f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:11.714915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:11.715548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:11.715824 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:11.716101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] PATH_INFO: `/v3/users/1a3d08bbd8aa4338b905ac912d1319fc` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:11.717426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3d08bbd8aa4338b905ac912d1319fc)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:11.719672 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:11.753519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:11.775144 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3d08bbd8aa4338b905ac912d1319fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:11.775741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3d08bbd8aa4338b905ac912d1319fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:11.784167 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3d08bbd8aa4338b905ac912d1319fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:11.793059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3d08bbd8aa4338b905ac912d1319fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:11.793704 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-cad2a74d-fc56-4a8f-bdcc-e184ddd5a5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3d08bbd8aa4338b905ac912d1319fc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:11.812491 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1321/2625] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:11 2022] DELETE /identity/v3/users/1a3d08bbd8aa4338b905ac912d1319fc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:12.013206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.025729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14c3e9-6a53-460a-aff6-7cc63dd31665 service glance] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.096035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.096672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.096978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.097249 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] PATH_INFO: `/v3/projects/d557c51c39144a43b93ef656a967b16e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.098365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d557c51c39144a43b93ef656a967b16e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.100279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.149456 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd557c51c39144a43b93ef656a967b16e', 'request_id': 'req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:12.158228 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd557c51c39144a43b93ef656a967b16e', 'request_id': 'req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:12.162979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:12.169751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd557c51c39144a43b93ef656a967b16e', 'request_id': 'req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:12.182315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] The token cache is being invalidate because project d557c51c39144a43b93ef656a967b16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:12.182611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:12.183409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d572f890-9bd9-4f4a-b2b4-fe3332ebae0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:12.185322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1305/2626] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:12 2022] DELETE /identity/v3/projects/d557c51c39144a43b93ef656a967b16e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:12.191490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2126e-79ee-4aa8-8c05-a8a74304fa1c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.191895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2126e-79ee-4aa8-8c05-a8a74304fa1c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.192072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2126e-79ee-4aa8-8c05-a8a74304fa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.217722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1ef2126e-79ee-4aa8-8c05-a8a74304fa1c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:12.219206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1ef2126e-79ee-4aa8-8c05-a8a74304fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:12.286943 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1322/2627] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:12.295118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beed6b7-06e7-47e2-b39b-c0282c97449c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.295523 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beed6b7-06e7-47e2-b39b-c0282c97449c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.295779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beed6b7-06e7-47e2-b39b-c0282c97449c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.317246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-5beed6b7-06e7-47e2-b39b-c0282c97449c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:12.318472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5beed6b7-06e7-47e2-b39b-c0282c97449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:12.327386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1306/2628] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:12.331967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2126e-79ee-4aa8-8c05-a8a74304fa1c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.343193 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2126e-79ee-4aa8-8c05-a8a74304fa1c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.348626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.349297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.349579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.349857 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.350568 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:12.350835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.352464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.364796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1323/2629] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:12.371142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beed6b7-06e7-47e2-b39b-c0282c97449c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.382511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beed6b7-06e7-47e2-b39b-c0282c97449c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.389558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.390214 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.390488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.390786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.391573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.393749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.430890 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1307/2630] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:12 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:59:12.435252 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.448166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3969353-f4a0-4611-b2a6-b6db0483b742 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.507884 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.508500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.508783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.509102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.509741 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.511691 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.539722 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1324/2631] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:12 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:12.541976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.555480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090bf68-987b-4749-a3da-aae4a2a0725b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.560729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.561405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.561675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.561946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.562608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.564302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.576868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1308/2632] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:12.579299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.589684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007a1e3-215a-4bb8-8fef-04a42a43b887 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.595079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdf564-a4e5-4529-b007-ab88b87d3469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.596044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdf564-a4e5-4529-b007-ab88b87d3469 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.596355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdf564-a4e5-4529-b007-ab88b87d3469 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.596571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdf564-a4e5-4529-b007-ab88b87d3469 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.597182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdf564-a4e5-4529-b007-ab88b87d3469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.599449 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdf564-a4e5-4529-b007-ab88b87d3469 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.611635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1325/2633] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:12.616079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.626445 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b73f3-f7eb-4ee4-8fb7-c26846620460 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.631362 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.632012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.632292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.632563 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] PATH_INFO: `/v3/projects/4c0e3a7025fa40b8adf789a39c19a96c/users/99e7d74fe5a84b8cbb4a68b88b49d32c/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.651294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0e3a7025fa40b8adf789a39c19a96c, user_id=99e7d74fe5a84b8cbb4a68b88b49d32c, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.654250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.669428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1309/2634] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:12 2022] PUT /identity/v3/projects/4c0e3a7025fa40b8adf789a39c19a96c/users/99e7d74fe5a84b8cbb4a68b88b49d32c/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:12.681271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df09f0-994d-4374-8d95-ab5d214c0045 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.682243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df09f0-994d-4374-8d95-ab5d214c0045 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.682243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df09f0-994d-4374-8d95-ab5d214c0045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.703564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:12.712471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e2df09f0-994d-4374-8d95-ab5d214c0045 None None] MFA Rules not processed for user `99e7d74fe5a84b8cbb4a68b88b49d32c`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:12.714293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e2df09f0-994d-4374-8d95-ab5d214c0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:12.782179 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1326/2635] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:59:12.787012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.856168 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0453f5-c76e-4abf-9cdb-31da5abd3e0a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.863561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.864392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.864719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.865095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.866043 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.869016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:12.901703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1310/2636] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:12 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:12.906308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df09f0-994d-4374-8d95-ab5d214c0045 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:12.918363 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df09f0-994d-4374-8d95-ab5d214c0045 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:12.978823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:12.979441 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:12.979726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:12.979995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:12.980625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:12.983085 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:13.006683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1327/2637] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:12 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:13.011503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:13.023222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7527c-707b-4292-9cd0-62b25a51a0cf admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:13.028586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:13.029259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:13.029601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:13.029869 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:13.030511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:13.032124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:13.043577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1311/2638] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:13.048110 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:13.058980 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d9489-8525-4649-be74-b4daa4db382c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:13.065072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:13.065734 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:13.066016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:13.066286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] PATH_INFO: `/v3/projects/c27284e1f1eb4a3bbe86ffb1f2e2c3fd/users/5d6193d2484441b288ce759e982ecfdc/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:13.084897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27284e1f1eb4a3bbe86ffb1f2e2c3fd, user_id=5d6193d2484441b288ce759e982ecfdc, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:13.087640 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:13.104481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1328/2639] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:13 2022] PUT /identity/v3/projects/c27284e1f1eb4a3bbe86ffb1f2e2c3fd/users/5d6193d2484441b288ce759e982ecfdc/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:13.109938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:13.124969 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696a01-8bee-49a2-95e0-910018c636f1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:13.188525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bd2b0-ec36-4806-94ef-dae63d3e4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:13.189176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bd2b0-ec36-4806-94ef-dae63d3e4486 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:13.189459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bd2b0-ec36-4806-94ef-dae63d3e4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:13.189733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bd2b0-ec36-4806-94ef-dae63d3e4486 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:13.190380 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bd2b0-ec36-4806-94ef-dae63d3e4486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:13.192003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bd2b0-ec36-4806-94ef-dae63d3e4486 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:13.193253 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:13.207428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1312/2640] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:13.208548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:13.220025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baa786-cd4c-4c8b-b6d0-52c0f397bbca admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:13.225706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:13.226370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:13.226649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:13.226918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] PATH_INFO: `/v3/projects/c27284e1f1eb4a3bbe86ffb1f2e2c3fd/users/5d6193d2484441b288ce759e982ecfdc/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:13.229098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27284e1f1eb4a3bbe86ffb1f2e2c3fd, user_id=5d6193d2484441b288ce759e982ecfdc, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:13.231769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:13.244337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1329/2641] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:13 2022] PUT /identity/v3/projects/c27284e1f1eb4a3bbe86ffb1f2e2c3fd/users/5d6193d2484441b288ce759e982ecfdc/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:59:13.256981 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f229-85bd-4bfb-840f-08187a18aea7 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:13.257324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f229-85bd-4bfb-840f-08187a18aea7 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:13.257676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759f229-85bd-4bfb-840f-08187a18aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:13.289978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7759f229-85bd-4bfb-840f-08187a18aea7 None None] MFA Rules not processed for user `5d6193d2484441b288ce759e982ecfdc`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:13.291219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7759f229-85bd-4bfb-840f-08187a18aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:13.367656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1313/2642] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:13.380345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:13.382444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:13.447748 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b4687-b76f-47a0-9d11-62edfc7ec8fe admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:13.452388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:13.453041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:13.453333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:13.453585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:13.461128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:13.464280 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:13.465925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:13.477458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1330/2643] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:13.570543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f229-85bd-4bfb-840f-08187a18aea7 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:13.581604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759f229-85bd-4bfb-840f-08187a18aea7 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:13.585399 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89d3e6-d027-4c9b-be5c-a3fbf75ee62b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:13.586337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d3e6-d027-4c9b-be5c-a3fbf75ee62b service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:13.586772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d3e6-d027-4c9b-be5c-a3fbf75ee62b service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:13.587963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89d3e6-d027-4c9b-be5c-a3fbf75ee62b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:13.650788 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89d3e6-d027-4c9b-be5c-a3fbf75ee62b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:13.652261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89d3e6-d027-4c9b-be5c-a3fbf75ee62b service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:13.661677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1314/2644] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:20.920432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:21.116248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1ebaf-fa0d-452d-9960-7f005f30db11 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:21.121966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:21.122607 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:21.122890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:21.123163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] PATH_INFO: `/v3/users/99e7d74fe5a84b8cbb4a68b88b49d32c` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:21.124369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e7d74fe5a84b8cbb4a68b88b49d32c)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:21.126365 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:21.183262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e7d74fe5a84b8cbb4a68b88b49d32c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.184015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e7d74fe5a84b8cbb4a68b88b49d32c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.191467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e7d74fe5a84b8cbb4a68b88b49d32c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.200641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e7d74fe5a84b8cbb4a68b88b49d32c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.201374 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e7d74fe5a84b8cbb4a68b88b49d32c'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.218842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1331/2645] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:20 2022] DELETE /identity/v3/users/99e7d74fe5a84b8cbb4a68b88b49d32c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:21.223826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:21.224342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:21.224342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:21.243968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:21.245201 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:21.306341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1315/2646] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:21.316345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:21.317939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:21.383702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f90c-0df8-467b-be4a-86589b2002cf admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:21.387809 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:21.388408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:21.388714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:21.389010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:21.398572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:21.399988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:21.409573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1332/2647] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:21.696400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:21.697989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:21.712190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ccb95-263d-4915-94a2-5ca62608bb5b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:21.717802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:21.718444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:21.718780 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:21.719076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] PATH_INFO: `/v3/projects/4c0e3a7025fa40b8adf789a39c19a96c` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:21.720550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0e3a7025fa40b8adf789a39c19a96c)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:21.722604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:21.740450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:21.774155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0e3a7025fa40b8adf789a39c19a96c', 'request_id': 'req-d45fc4d8-ca22-4c8f-b962-8595f3182c87'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.783326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0e3a7025fa40b8adf789a39c19a96c', 'request_id': 'req-d45fc4d8-ca22-4c8f-b962-8595f3182c87'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.789292 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0e3a7025fa40b8adf789a39c19a96c', 'request_id': 'req-d45fc4d8-ca22-4c8f-b962-8595f3182c87'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.800801 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] The token cache is being invalidate because project 4c0e3a7025fa40b8adf789a39c19a96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:21.801130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.801867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.803498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1316/2648] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:21 2022] DELETE /identity/v3/projects/4c0e3a7025fa40b8adf789a39c19a96c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:21.807708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:21.817627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61136771-ce8e-48d0-8444-3fd041f903f3 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:21.830529 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:21.878760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:21.879380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:21.879668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:21.879944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] PATH_INFO: `/v3/users/5d6193d2484441b288ce759e982ecfdc` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:21.881177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6193d2484441b288ce759e982ecfdc)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:21.883103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:21.935337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6193d2484441b288ce759e982ecfdc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.935972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6193d2484441b288ce759e982ecfdc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.943178 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6193d2484441b288ce759e982ecfdc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.952142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6193d2484441b288ce759e982ecfdc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.952746 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ea112eb6-c0a2-421e-b996-9a01244229aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6193d2484441b288ce759e982ecfdc'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:21.970984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1333/2649] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:21 2022] DELETE /identity/v3/users/5d6193d2484441b288ce759e982ecfdc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:22.253859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:22.255382 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:22.271263 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fc4d8-ca22-4c8f-b962-8595f3182c87 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:22.333775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:22.334689 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.335095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.335533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] PATH_INFO: `/v3/projects/c27284e1f1eb4a3bbe86ffb1f2e2c3fd` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.337353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27284e1f1eb4a3bbe86ffb1f2e2c3fd)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:22.340303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:22.387639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27284e1f1eb4a3bbe86ffb1f2e2c3fd', 'request_id': 'req-a2334c96-d258-408b-b4c6-cee286f0f56f'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:22.397300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27284e1f1eb4a3bbe86ffb1f2e2c3fd', 'request_id': 'req-a2334c96-d258-408b-b4c6-cee286f0f56f'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:22.403424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27284e1f1eb4a3bbe86ffb1f2e2c3fd', 'request_id': 'req-a2334c96-d258-408b-b4c6-cee286f0f56f'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:22.414999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] The token cache is being invalidate because project c27284e1f1eb4a3bbe86ffb1f2e2c3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:22.415288 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:22.416008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-a2334c96-d258-408b-b4c6-cee286f0f56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:22.417877 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1317/2650] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:22 2022] DELETE /identity/v3/projects/c27284e1f1eb4a3bbe86ffb1f2e2c3fd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:22.422978 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a4333-0bc1-4461-bebd-03a348e7215a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.423270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a4333-0bc1-4461-bebd-03a348e7215a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.423571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a4333-0bc1-4461-bebd-03a348e7215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.443644 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-395a4333-0bc1-4461-bebd-03a348e7215a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:22.444758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-395a4333-0bc1-4461-bebd-03a348e7215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:22.503733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1334/2651] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:22.512015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe80e5-e122-4606-acc0-a5bf021fdd64 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.512304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe80e5-e122-4606-acc0-a5bf021fdd64 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.512578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe80e5-e122-4606-acc0-a5bf021fdd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.533861 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-30fe80e5-e122-4606-acc0-a5bf021fdd64 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:22.535113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-30fe80e5-e122-4606-acc0-a5bf021fdd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:22.549016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1318/2652] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:22.553829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a4333-0bc1-4461-bebd-03a348e7215a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:22.564619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a4333-0bc1-4461-bebd-03a348e7215a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:22.571727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:22.572601 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.573051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.573446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.574480 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:22.574928 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:22.577438 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:22.595859 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1335/2653] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:22.602290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe80e5-e122-4606-acc0-a5bf021fdd64 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:22.621784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe80e5-e122-4606-acc0-a5bf021fdd64 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:22.628324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:22.629007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.629259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.629525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.630193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:22.632109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:22.660796 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:22.680864 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1319/2654] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:22 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:22.682262 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:22.693159 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b824f1-11f7-41b1-b8e6-769bb8a24265 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:22.713938 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:22.754047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:22.754659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.754942 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.755207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.755882 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:22.758260 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:22.782396 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1336/2655] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:22 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:22.786913 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:22.797936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff41ca-c89d-4fd9-86c1-5a00961a4a34 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:22.803438 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:22.804038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.804318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.804588 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.805283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:22.806899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:22.817287 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1320/2656] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:22.821484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:22.832058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95d531-ca0c-4f05-8388-1064d5794238 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:22.837271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304108b3-8b5f-423b-b8e7-a33845f36400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:22.837875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304108b3-8b5f-423b-b8e7-a33845f36400 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.838177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304108b3-8b5f-423b-b8e7-a33845f36400 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.838424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304108b3-8b5f-423b-b8e7-a33845f36400 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.839052 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304108b3-8b5f-423b-b8e7-a33845f36400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:22.840684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304108b3-8b5f-423b-b8e7-a33845f36400 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:22.850987 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1337/2657] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:22.855053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:22.865432 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b98f79-93d3-4cf5-9e0a-b6d9238da1ce admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:22.870603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:22.871255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.871652 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.871926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] PATH_INFO: `/v3/projects/bd9c7ad1a87e447aa9db206625172d66/users/b4aaefc49f7745efb12cd073d2a7539e/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.888241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9c7ad1a87e447aa9db206625172d66, user_id=b4aaefc49f7745efb12cd073d2a7539e, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:22.891007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:22.906154 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1321/2658] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:22 2022] PUT /identity/v3/projects/bd9c7ad1a87e447aa9db206625172d66/users/b4aaefc49f7745efb12cd073d2a7539e/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:22.916521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4be82-cffc-4479-890d-9337005de400 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:22.916804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4be82-cffc-4479-890d-9337005de400 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:22.917119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4be82-cffc-4479-890d-9337005de400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:22.945976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-dde4be82-cffc-4479-890d-9337005de400 None None] MFA Rules not processed for user `b4aaefc49f7745efb12cd073d2a7539e`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:22.947190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-dde4be82-cffc-4479-890d-9337005de400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:23.013851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1338/2659] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:23.020138 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:23.086797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7849065-ff35-48d6-862a-2ea703f090b9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:23.092234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:23.092828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.093110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.093400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.094023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:23.096252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:23.125723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1322/2660] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:23 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:23.129984 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4be82-cffc-4479-890d-9337005de400 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:23.141737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4be82-cffc-4479-890d-9337005de400 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:23.209484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:23.210325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.210633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.210925 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.211836 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:23.214782 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:23.237708 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1339/2661] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:23 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:59:23.241789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:23.252002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae04ed-1747-43bb-a708-d6c66c6a9743 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:23.257156 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:23.257723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.258032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.258200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.258839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:23.260452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:23.271663 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1323/2662] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:23.275827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:23.286649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556d88-f32b-40f3-bd81-c01420fab6df admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:23.292064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:23.292767 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.293091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.293403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] PATH_INFO: `/v3/projects/565e0fbb1d264de4a2d4fb17534dceda/users/ba2560fc972846ecb2f0d22f67be624c/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.308496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565e0fbb1d264de4a2d4fb17534dceda, user_id=ba2560fc972846ecb2f0d22f67be624c, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:23.311235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:23.322298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:23.329347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1340/2663] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:23 2022] PUT /identity/v3/projects/565e0fbb1d264de4a2d4fb17534dceda/users/ba2560fc972846ecb2f0d22f67be624c/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:23.333886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:23.347338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d8907-a53a-4f05-8728-4c32b5b3703f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:23.407855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ea329-70d3-45ae-b775-6e974dca7134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:23.408481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea329-70d3-45ae-b775-6e974dca7134 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.408763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea329-70d3-45ae-b775-6e974dca7134 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.409052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea329-70d3-45ae-b775-6e974dca7134 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.409690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ea329-70d3-45ae-b775-6e974dca7134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:23.411278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ea329-70d3-45ae-b775-6e974dca7134 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:23.421686 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1324/2664] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:23.426377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:23.437217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172b4eb-6980-405f-9883-0befa320c801 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:23.442739 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:23.443397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.443682 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.443968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] PATH_INFO: `/v3/projects/565e0fbb1d264de4a2d4fb17534dceda/users/ba2560fc972846ecb2f0d22f67be624c/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.446412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=565e0fbb1d264de4a2d4fb17534dceda, user_id=ba2560fc972846ecb2f0d22f67be624c, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:23.449070 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:23.460415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1341/2665] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:23 2022] PUT /identity/v3/projects/565e0fbb1d264de4a2d4fb17534dceda/users/ba2560fc972846ecb2f0d22f67be624c/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:23.472545 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0e489-9380-4434-a92d-a5d438f13c40 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.472831 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0e489-9380-4434-a92d-a5d438f13c40 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.473136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0e489-9380-4434-a92d-a5d438f13c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.503175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-82c0e489-9380-4434-a92d-a5d438f13c40 None None] MFA Rules not processed for user `ba2560fc972846ecb2f0d22f67be624c`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:23.504386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-82c0e489-9380-4434-a92d-a5d438f13c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:23.524552 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:23.584313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1325/2666] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:23.596098 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:23.597968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:23.661174 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697429b3-20a1-4aa8-b2a8-4c55145c9f2f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:23.665355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa254543-8045-4b50-b607-7f3a910a5a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:23.665974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa254543-8045-4b50-b607-7f3a910a5a80 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:23.666251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa254543-8045-4b50-b607-7f3a910a5a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:23.666520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa254543-8045-4b50-b607-7f3a910a5a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:23.676211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa254543-8045-4b50-b607-7f3a910a5a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:23.677760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa254543-8045-4b50-b607-7f3a910a5a80 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:23.687279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1342/2667] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:25.124818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0e489-9380-4434-a92d-a5d438f13c40 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:25.190472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0e489-9380-4434-a92d-a5d438f13c40 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:25.195354 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:25.195994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:25.196274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:25.196542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] PATH_INFO: `/v3/users/b4aaefc49f7745efb12cd073d2a7539e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:25.197719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4aaefc49f7745efb12cd073d2a7539e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:25.199690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:25.250002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4aaefc49f7745efb12cd073d2a7539e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.250673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4aaefc49f7745efb12cd073d2a7539e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.260763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4aaefc49f7745efb12cd073d2a7539e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.261509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4aaefc49f7745efb12cd073d2a7539e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.274149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4aaefc49f7745efb12cd073d2a7539e'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.287737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1326/2668] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:25 2022] DELETE /identity/v3/users/b4aaefc49f7745efb12cd073d2a7539e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:25.292771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:25.293435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:25.293435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:25.313460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:25.314684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:25.378868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1343/2669] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:25.391924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:25.393718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:25.436420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:25.456062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ab877-e006-45f7-8a83-a1f8e3b673f2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:25.459955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:25.460572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:25.460855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:25.461192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:25.472188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:25.473809 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:25.484459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1327/2670] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:25.775303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:25.776757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:25.789419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bef74c-f488-4507-b150-3edc07085dfc None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:25.794796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:25.795514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:25.795797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:25.796058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] PATH_INFO: `/v3/projects/bd9c7ad1a87e447aa9db206625172d66` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:25.797251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9c7ad1a87e447aa9db206625172d66)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:25.799368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:25.862513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9c7ad1a87e447aa9db206625172d66', 'request_id': 'req-b3451d84-580e-4943-a24d-f16e9150b206'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.869331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9c7ad1a87e447aa9db206625172d66', 'request_id': 'req-b3451d84-580e-4943-a24d-f16e9150b206'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.876235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9c7ad1a87e447aa9db206625172d66', 'request_id': 'req-b3451d84-580e-4943-a24d-f16e9150b206'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.891258 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] The token cache is being invalidate because project bd9c7ad1a87e447aa9db206625172d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:25.891547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.892157 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:25.893694 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1344/2671] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:25 2022] DELETE /identity/v3/projects/bd9c7ad1a87e447aa9db206625172d66 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:25.897888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:25.908226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb75c8-b7f7-49cd-8ac4-363be88f7545 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:25.970453 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:25.971091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:25.971372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:25.971647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] PATH_INFO: `/v3/users/ba2560fc972846ecb2f0d22f67be624c` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:25.972798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2560fc972846ecb2f0d22f67be624c)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:25.974837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:26.027400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2560fc972846ecb2f0d22f67be624c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.028109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2560fc972846ecb2f0d22f67be624c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.038723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2560fc972846ecb2f0d22f67be624c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.039719 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2560fc972846ecb2f0d22f67be624c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.055243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6af81238-4751-4934-893d-4f9e7ead511a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2560fc972846ecb2f0d22f67be624c'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.068632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1328/2672] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:25 2022] DELETE /identity/v3/users/ba2560fc972846ecb2f0d22f67be624c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:26.362988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:26.364653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:26.380875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3451d84-580e-4943-a24d-f16e9150b206 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:26.391320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:26.443163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:26.443810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.444089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.444361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] PATH_INFO: `/v3/projects/565e0fbb1d264de4a2d4fb17534dceda` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.445561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565e0fbb1d264de4a2d4fb17534dceda)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:26.447477 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:26.497635 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565e0fbb1d264de4a2d4fb17534dceda', 'request_id': 'req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.505086 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565e0fbb1d264de4a2d4fb17534dceda', 'request_id': 'req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.510816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565e0fbb1d264de4a2d4fb17534dceda', 'request_id': 'req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.524496 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] The token cache is being invalidate because project 565e0fbb1d264de4a2d4fb17534dceda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:26.524786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.525425 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-e3aa2d83-4d07-4ab1-96cc-dd9b488d5e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:26.526910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1345/2673] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:26 2022] DELETE /identity/v3/projects/565e0fbb1d264de4a2d4fb17534dceda => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:26.532155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc239f-eca5-4404-af68-184572ab30fe None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.532660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc239f-eca5-4404-af68-184572ab30fe None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.532660 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc239f-eca5-4404-af68-184572ab30fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.553327 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-96bc239f-eca5-4404-af68-184572ab30fe None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:26.554522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-96bc239f-eca5-4404-af68-184572ab30fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:26.605300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:26.618000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1329/2674] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:26.631593 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34bd39-9e17-421c-b2dd-736628de0f4a None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.632071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34bd39-9e17-421c-b2dd-736628de0f4a None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.632505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34bd39-9e17-421c-b2dd-736628de0f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.656531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1a34bd39-9e17-421c-b2dd-736628de0f4a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:26.658354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1a34bd39-9e17-421c-b2dd-736628de0f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:26.669924 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1346/2675] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:26.675378 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc239f-eca5-4404-af68-184572ab30fe None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:26.688651 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc239f-eca5-4404-af68-184572ab30fe None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:26.696797 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:26.697840 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.698301 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.698750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.699802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:26.700644 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:26.702213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:26.714630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1330/2676] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:26.721309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34bd39-9e17-421c-b2dd-736628de0f4a None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:26.734417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34bd39-9e17-421c-b2dd-736628de0f4a None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:26.740220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:26.740826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.741142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.741397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.742026 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:26.743944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:26.776042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1347/2677] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:26 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:26.780599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:26.792237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce1d8c-cbd1-48a9-ae8d-7d2d58afed50 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:26.857819 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:26.858444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.858735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.859014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.859681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:26.861692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:26.888013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1331/2678] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:26 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:26.889297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:26.899852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f0aef-1005-45e8-a693-4663b466e783 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:26.905492 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:26.906104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.906385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.906663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.907314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:26.908975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:26.919618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1348/2679] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:59:26.924285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:26.936109 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018991f-d034-4b51-b0e7-cc037cead781 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:26.941718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4c193-3425-4e55-a641-8702719fe4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:26.942277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c193-3425-4e55-a641-8702719fe4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.942586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c193-3425-4e55-a641-8702719fe4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.942844 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4c193-3425-4e55-a641-8702719fe4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.943503 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4c193-3425-4e55-a641-8702719fe4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:26.945198 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4c193-3425-4e55-a641-8702719fe4f8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:26.956866 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1332/2680] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:26.961718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:26.973361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31348e-3716-4b33-ad98-70672e933e7c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:26.978546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:26.979207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:26.979484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:26.979755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] PATH_INFO: `/v3/projects/3e61ca409d1b4471898f0ebe678df269/users/b0ce2391ab524f509d24c1df921bf888/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:26.996871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e61ca409d1b4471898f0ebe678df269, user_id=b0ce2391ab524f509d24c1df921bf888, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:26.999776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.015108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1349/2681] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:26 2022] PUT /identity/v3/projects/3e61ca409d1b4471898f0ebe678df269/users/b0ce2391ab524f509d24c1df921bf888/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:27.030946 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bdbdd-af6e-4597-9016-5be3fe343b63 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.031240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bdbdd-af6e-4597-9016-5be3fe343b63 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.031514 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bdbdd-af6e-4597-9016-5be3fe343b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.061367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-2e5bdbdd-af6e-4597-9016-5be3fe343b63 None None] MFA Rules not processed for user `b0ce2391ab524f509d24c1df921bf888`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:27.062604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2e5bdbdd-af6e-4597-9016-5be3fe343b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:27.131047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1333/2682] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:27.135897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.178214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:27.202053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e2356-1160-4dab-8050-ec346d2d613c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.207115 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.207723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.207999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.208264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.208890 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.210807 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.241248 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1350/2683] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:27 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:59:27.245364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bdbdd-af6e-4597-9016-5be3fe343b63 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.256947 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bdbdd-af6e-4597-9016-5be3fe343b63 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.305300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:27.316717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.317363 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.317699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.317904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.318556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.320496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.344277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1334/2684] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:27 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:59:27.348728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.359430 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2313d-1969-4924-90bc-c6cd96d11cd8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.364611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.365231 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.365503 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.365776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.366417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.368041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.379414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1351/2685] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:59:27.383749 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.394398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6838-5b2f-4c5a-a84e-c0c95a544d36 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.402813 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.403768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.404123 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.404469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] PATH_INFO: `/v3/projects/818836880ea74255a8f5b944f76f8e4f/users/e9de69f77ffe4b028acacc66eb74b5f4/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.424562 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818836880ea74255a8f5b944f76f8e4f, user_id=e9de69f77ffe4b028acacc66eb74b5f4, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.427277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.443468 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1335/2686] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:27 2022] PUT /identity/v3/projects/818836880ea74255a8f5b944f76f8e4f/users/e9de69f77ffe4b028acacc66eb74b5f4/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:27.447589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.457920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd8af-498b-4c8e-a32b-2318ad9c4f41 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.518989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b855d9-89a1-4b18-9b93-93a5654d47b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.519592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b855d9-89a1-4b18-9b93-93a5654d47b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.520348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b855d9-89a1-4b18-9b93-93a5654d47b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.520630 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b855d9-89a1-4b18-9b93-93a5654d47b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.521301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b855d9-89a1-4b18-9b93-93a5654d47b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.522881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b855d9-89a1-4b18-9b93-93a5654d47b4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.532946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1352/2687] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:27.537181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.548105 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deb081-587a-42ee-909c-eedbeff13077 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.553077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.553734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.554006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.554278 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] PATH_INFO: `/v3/projects/818836880ea74255a8f5b944f76f8e4f/users/e9de69f77ffe4b028acacc66eb74b5f4/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.556223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818836880ea74255a8f5b944f76f8e4f, user_id=e9de69f77ffe4b028acacc66eb74b5f4, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.558904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.569420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1336/2688] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:27 2022] PUT /identity/v3/projects/818836880ea74255a8f5b944f76f8e4f/users/e9de69f77ffe4b028acacc66eb74b5f4/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:27.584176 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3073e-c46b-483f-a674-f59163816469 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.584459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3073e-c46b-483f-a674-f59163816469 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.584728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3073e-c46b-483f-a674-f59163816469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.614314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c6a3073e-c46b-483f-a674-f59163816469 None None] MFA Rules not processed for user `e9de69f77ffe4b028acacc66eb74b5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:27.615510 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c6a3073e-c46b-483f-a674-f59163816469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:27.694247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1353/2689] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:27.705821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.707597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:27.766241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5749e11-01bb-4875-8d8b-fa2903288652 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.770520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7387-3d93-41e4-bc84-c82acb4b990e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.771130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7387-3d93-41e4-bc84-c82acb4b990e service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.771411 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7387-3d93-41e4-bc84-c82acb4b990e service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.771680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7387-3d93-41e4-bc84-c82acb4b990e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.780941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7387-3d93-41e4-bc84-c82acb4b990e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.782409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7387-3d93-41e4-bc84-c82acb4b990e service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.791763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1337/2690] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:27.820989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3073e-c46b-483f-a674-f59163816469 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:27.856359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:27.885531 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3073e-c46b-483f-a674-f59163816469 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:27.890520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:27.891161 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.891446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.891717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] PATH_INFO: `/v3/users/b0ce2391ab524f509d24c1df921bf888` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:27.892894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ce2391ab524f509d24c1df921bf888)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:27.894854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:27.945886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ce2391ab524f509d24c1df921bf888'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:27.946572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ce2391ab524f509d24c1df921bf888'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:27.953893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ce2391ab524f509d24c1df921bf888'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:27.963484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ce2391ab524f509d24c1df921bf888'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:27.964165 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ce2391ab524f509d24c1df921bf888'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:27.983206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1354/2691] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:27 2022] DELETE /identity/v3/users/b0ce2391ab524f509d24c1df921bf888 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:27.987839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:27.988144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:27.988434 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:28.008426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:28.009674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:28.073729 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1338/2692] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:28.084702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:28.086395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:28.147451 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddd284-142a-4258-b103-dfd373d4aab6 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:28.151385 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:28.152061 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:28.152747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:28.153204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:28.165094 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:28.166546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:28.176931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1355/2693] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:28.458777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:28.460300 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:28.474002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799799c-0abf-4f86-be0e-96c64f6206f6 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:28.479208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:28.479856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:28.480595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:28.480595 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] PATH_INFO: `/v3/projects/3e61ca409d1b4471898f0ebe678df269` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:28.481742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e61ca409d1b4471898f0ebe678df269)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:28.483829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:28.534938 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:28.539150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e61ca409d1b4471898f0ebe678df269', 'request_id': 'req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.548820 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e61ca409d1b4471898f0ebe678df269', 'request_id': 'req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.554590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e61ca409d1b4471898f0ebe678df269', 'request_id': 'req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.565932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] The token cache is being invalidate because project 3e61ca409d1b4471898f0ebe678df269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:28.566221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.566882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.568451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1339/2694] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:28 2022] DELETE /identity/v3/projects/3e61ca409d1b4471898f0ebe678df269 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:28.572690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:28.582907 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb82399-68e2-40ae-9a4e-938f2e5c982b service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:28.640738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:28.645793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:28.646483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:28.646770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:28.647099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] PATH_INFO: `/v3/users/e9de69f77ffe4b028acacc66eb74b5f4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:28.648822 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9de69f77ffe4b028acacc66eb74b5f4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:28.651250 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:28.701381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9de69f77ffe4b028acacc66eb74b5f4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.702044 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9de69f77ffe4b028acacc66eb74b5f4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.708935 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9de69f77ffe4b028acacc66eb74b5f4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.717783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9de69f77ffe4b028acacc66eb74b5f4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.718444 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-94abc204-f4be-4b62-a935-95cd9b54f52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9de69f77ffe4b028acacc66eb74b5f4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:28.736312 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1356/2695] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:28 2022] DELETE /identity/v3/users/e9de69f77ffe4b028acacc66eb74b5f4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:29.017982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.019507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:29.033443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e3c1-587b-4aa6-8dbc-13e6615a38e1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.090655 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.091274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.091553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.091828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] PATH_INFO: `/v3/projects/818836880ea74255a8f5b944f76f8e4f` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.093008 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=818836880ea74255a8f5b944f76f8e4f)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.094900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.146967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818836880ea74255a8f5b944f76f8e4f', 'request_id': 'req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:29.156091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818836880ea74255a8f5b944f76f8e4f', 'request_id': 'req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:29.166664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818836880ea74255a8f5b944f76f8e4f', 'request_id': 'req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:29.179250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] The token cache is being invalidate because project 818836880ea74255a8f5b944f76f8e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:29.179544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:29.180318 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-48774f1a-6ebe-4d14-868c-8c6aed2c89cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:29.182135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1340/2696] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:29 2022] DELETE /identity/v3/projects/818836880ea74255a8f5b944f76f8e4f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:29.187479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace830d-a174-455d-ace4-383d359cd65e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.187766 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace830d-a174-455d-ace4-383d359cd65e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.188038 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace830d-a174-455d-ace4-383d359cd65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.211726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-7ace830d-a174-455d-ace4-383d359cd65e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:29.211726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7ace830d-a174-455d-ace4-383d359cd65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:29.274582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1357/2697] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:29.282937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e835fe-0d83-4de0-a202-a5ab61a9fd28 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.283233 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e835fe-0d83-4de0-a202-a5ab61a9fd28 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.283546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e835fe-0d83-4de0-a202-a5ab61a9fd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.305828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-91e835fe-0d83-4de0-a202-a5ab61a9fd28 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:29.307133 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-91e835fe-0d83-4de0-a202-a5ab61a9fd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:29.316972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1341/2698] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:29.321373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace830d-a174-455d-ace4-383d359cd65e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.331603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace830d-a174-455d-ace4-383d359cd65e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.336095 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.336687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.336997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.337269 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.337926 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:29.338212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.339796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.352287 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1358/2699] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:29.356972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e835fe-0d83-4de0-a202-a5ab61a9fd28 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.366361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e835fe-0d83-4de0-a202-a5ab61a9fd28 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.371875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.372779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.373101 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.373373 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.374017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.376003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.406423 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1342/2700] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:29 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:29.410940 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.422866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38cdf5-c699-4269-9f74-1b35b3d39da0 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.489134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.489134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.489134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.489134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.489676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.489676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.498382 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:29.518439 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1359/2701] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:29 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:29.522574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.534921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068cb78-cb82-4171-91cd-102c99f311e3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.554140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.554774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.555052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.555320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.555979 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.557658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.568582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1343/2702] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:59:29.572902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.584470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f9e52-62d8-4c09-9fe8-5d327907c203 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.589407 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ab1ee-fc57-4218-80f2-f3d71db884db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.590166 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab1ee-fc57-4218-80f2-f3d71db884db admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.590458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab1ee-fc57-4218-80f2-f3d71db884db admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.590785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab1ee-fc57-4218-80f2-f3d71db884db admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.592204 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ab1ee-fc57-4218-80f2-f3d71db884db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.593770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ab1ee-fc57-4218-80f2-f3d71db884db admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.608903 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1360/2703] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:29.610190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.620420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a8ca-2b5d-4cbc-beb8-c35607b04e8e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.625401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.626049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.626328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.626600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] PATH_INFO: `/v3/projects/ece7de79c6454cafa04d3522233fcd1b/users/5ab07a5963ac4ad483b37c9949913414/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.642682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece7de79c6454cafa04d3522233fcd1b, user_id=5ab07a5963ac4ad483b37c9949913414, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.645396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.656181 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:29.663080 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1344/2704] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:29 2022] PUT /identity/v3/projects/ece7de79c6454cafa04d3522233fcd1b/users/5ab07a5963ac4ad483b37c9949913414/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:29.675218 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23062-0365-4561-863f-b21d8435e04c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.675523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23062-0365-4561-863f-b21d8435e04c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.675798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23062-0365-4561-863f-b21d8435e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.705405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-79b23062-0365-4561-863f-b21d8435e04c None None] MFA Rules not processed for user `5ab07a5963ac4ad483b37c9949913414`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:29.706622 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-79b23062-0365-4561-863f-b21d8435e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:29.774004 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1361/2705] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:59:29.785848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:29.788654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:29.850402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608d1f0-e944-4f0c-8283-eb0c685174e2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:29.854402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455dbc2-a091-46a2-9885-edff619f6e3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22a017e6b1d64044b4f5e3fb67cfd67f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:29.854976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455dbc2-a091-46a2-9885-edff619f6e3d service glance] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:29.855252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455dbc2-a091-46a2-9885-edff619f6e3d service glance] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:29.855522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455dbc2-a091-46a2-9885-edff619f6e3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:29.864053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455dbc2-a091-46a2-9885-edff619f6e3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:29.865533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455dbc2-a091-46a2-9885-edff619f6e3d service glance] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:29.874525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1345/2706] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:36.556424 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b23062-0365-4561-863f-b21d8435e04c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:36.558170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-79b23062-0365-4561-863f-b21d8435e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:36.630754 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b23062-0365-4561-863f-b21d8435e04c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:36.635974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:36.636616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:36.637029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:36.637304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] PATH_INFO: `/v3/users/54e737f7d44e4b55ae01a2cccec8ae60` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:36.638483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e737f7d44e4b55ae01a2cccec8ae60)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:36.640434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:36.702536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e737f7d44e4b55ae01a2cccec8ae60'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:36.703251 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e737f7d44e4b55ae01a2cccec8ae60'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:36.711295 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e737f7d44e4b55ae01a2cccec8ae60'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:36.721861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e737f7d44e4b55ae01a2cccec8ae60'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:36.722508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e737f7d44e4b55ae01a2cccec8ae60'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:36.730033 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:36.745674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1362/2707] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:36 2022] DELETE /identity/v3/users/54e737f7d44e4b55ae01a2cccec8ae60 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:36.750305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:36.750802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:36.750897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:36.771216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:36.772421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:36.837706 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1346/2708] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:36.848043 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:36.849508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:36.923139 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674aa5b-3492-4f01-bf29-2ba8289d92ca admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:36.927524 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73288f-1bdc-4a5c-a8c6-37febba9fa37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:36.928156 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73288f-1bdc-4a5c-a8c6-37febba9fa37 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:36.928446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73288f-1bdc-4a5c-a8c6-37febba9fa37 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:36.928724 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73288f-1bdc-4a5c-a8c6-37febba9fa37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:36.939072 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73288f-1bdc-4a5c-a8c6-37febba9fa37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:36.940547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73288f-1bdc-4a5c-a8c6-37febba9fa37 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:36.950249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1363/2709] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:59:37.239626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.241247 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:37.255722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a23b80-73af-436b-8b9b-e4f69d3486fd None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:37.260992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:37.262050 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.262255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.262474 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] PATH_INFO: `/v3/projects/73ef0595331443c7916b4a502fbf0a07` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.263664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ef0595331443c7916b4a502fbf0a07)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:37.266192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:37.320893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ef0595331443c7916b4a502fbf0a07', 'request_id': 'req-d2f316b3-c829-4b3f-9254-599f3937ab72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:37.330099 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ef0595331443c7916b4a502fbf0a07', 'request_id': 'req-d2f316b3-c829-4b3f-9254-599f3937ab72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:37.335495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ef0595331443c7916b4a502fbf0a07', 'request_id': 'req-d2f316b3-c829-4b3f-9254-599f3937ab72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:37.347421 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] The token cache is being invalidate because project 73ef0595331443c7916b4a502fbf0a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:37.347712 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:37.348414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-d2f316b3-c829-4b3f-9254-599f3937ab72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:37.350396 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1347/2710] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:37 2022] DELETE /identity/v3/projects/73ef0595331443c7916b4a502fbf0a07 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:37.356186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab652e14-42bb-4e4c-917c-abf1163e7dd1 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.356481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab652e14-42bb-4e4c-917c-abf1163e7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.356800 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab652e14-42bb-4e4c-917c-abf1163e7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.377060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ab652e14-42bb-4e4c-917c-abf1163e7dd1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:37.378283 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ab652e14-42bb-4e4c-917c-abf1163e7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:37.439683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1364/2711] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:37.450110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46dd4-33dc-43f3-8f12-785e9c001981 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.450401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46dd4-33dc-43f3-8f12-785e9c001981 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.450856 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46dd4-33dc-43f3-8f12-785e9c001981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.477818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-4ff46dd4-33dc-43f3-8f12-785e9c001981 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:37.479175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4ff46dd4-33dc-43f3-8f12-785e9c001981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:37.488817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1348/2712] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:37.493440 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab652e14-42bb-4e4c-917c-abf1163e7dd1 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.504415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab652e14-42bb-4e4c-917c-abf1163e7dd1 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:37.509254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:37.509886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.510169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.510475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.511422 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:37.511753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:37.514355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:37.527515 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1365/2713] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 03:59:37.532027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff46dd4-33dc-43f3-8f12-785e9c001981 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.542762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff46dd4-33dc-43f3-8f12-785e9c001981 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:37.547837 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:37.548613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.548893 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.549205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.549842 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:37.552676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:37.572076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:37.589176 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1349/2714] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:37 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:37.591398 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.602333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90b085-1ba8-437c-b74f-c2d1d8e97ded admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:37.660728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:37.661426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.661709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.661986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.662632 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:37.664576 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:37.688995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1366/2715] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:37 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:37.693407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.704322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b92a1c-23d7-4387-8094-59ee4f44010a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:37.709150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:37.709783 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.710070 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.710338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.710995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:37.712645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:37.724199 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1350/2716] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:37.728671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.739410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebfcf9-aa01-4e2d-a684-446274932395 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:37.744281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea16e9-db7a-4ca6-a32c-b3aa31113af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:37.744931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea16e9-db7a-4ca6-a32c-b3aa31113af9 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.745228 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea16e9-db7a-4ca6-a32c-b3aa31113af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.745504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea16e9-db7a-4ca6-a32c-b3aa31113af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.746150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea16e9-db7a-4ca6-a32c-b3aa31113af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:37.751643 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea16e9-db7a-4ca6-a32c-b3aa31113af9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:37.752654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:37.763169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1367/2717] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:37.767981 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.783505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8660feb-45bf-41f4-9366-4ae098dce16f admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:37.790585 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:37.791619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.792079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.792537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] PATH_INFO: `/v3/projects/604c7d1f12d9411a969e02e2820df387/users/d8aeeb8f30ce417b875f52e2e3e85552/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.809417 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604c7d1f12d9411a969e02e2820df387, user_id=d8aeeb8f30ce417b875f52e2e3e85552, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:37.812122 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:37.830049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1351/2718] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:37 2022] PUT /identity/v3/projects/604c7d1f12d9411a969e02e2820df387/users/d8aeeb8f30ce417b875f52e2e3e85552/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:37.835286 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cda11-7684-4f85-b2a2-5cddc4310b69 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:37.835562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cda11-7684-4f85-b2a2-5cddc4310b69 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:37.835843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cda11-7684-4f85-b2a2-5cddc4310b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:37.857881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-635cda11-7684-4f85-b2a2-5cddc4310b69 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:37.859147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-635cda11-7684-4f85-b2a2-5cddc4310b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:37.927386 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1368/2719] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:37.937814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:37.939674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:38.004285 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26572d28-e967-4cd7-818f-36ea824a5ab0 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:38.008333 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:38.008987 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:38.009303 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:38.009577 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:38.019676 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:38.021155 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:38.031039 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1352/2720] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:42.075954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31442-8729-4edd-b663-9e2922e6f64b None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:42.076539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31442-8729-4edd-b663-9e2922e6f64b None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:42.076539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31442-8729-4edd-b663-9e2922e6f64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:42.113478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5db31442-8729-4edd-b663-9e2922e6f64b None None] MFA Rules not processed for user `d8aeeb8f30ce417b875f52e2e3e85552`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:42.114713 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5db31442-8729-4edd-b663-9e2922e6f64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:42.184811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1369/2721] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:42.189541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:42.199424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445c99c-e029-4748-9457-0ff2c9288fb8 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:42.204720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:42.205364 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:42.205679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:42.206018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:42.206677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:42.208631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:42.239289 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1353/2722] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:42 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:59:42.243372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31442-8729-4edd-b663-9e2922e6f64b None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:42.254436 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31442-8729-4edd-b663-9e2922e6f64b None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:42.329992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:42.330720 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:42.331064 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:42.331403 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:42.332034 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:42.333995 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:42.358893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1370/2723] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:42 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:42.365136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:42.376328 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076168c3-8b6c-4467-8b0f-708a334eb6ba admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:42.381086 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:42.381728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:42.382012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:42.382829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:42.383488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:42.386501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:42.399021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1354/2724] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:42.403423 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:42.413897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59670eea-85d1-4ef2-b8be-b13750a778da admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:42.418662 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:42.419341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:42.419615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:42.419887 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] PATH_INFO: `/v3/projects/3d0141fef03e4adc93db1f0a5bbcbe10/users/4f0e2eebb94c4bd69a0a5fcbc92997fa/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:42.435620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0141fef03e4adc93db1f0a5bbcbe10, user_id=4f0e2eebb94c4bd69a0a5fcbc92997fa, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:42.438310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:42.440843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:42.455557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1371/2725] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:42 2022] PUT /identity/v3/projects/3d0141fef03e4adc93db1f0a5bbcbe10/users/4f0e2eebb94c4bd69a0a5fcbc92997fa/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:42.459643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:42.470475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f62f04-0b33-44af-b22e-675e4863eb44 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:42.529990 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:42.530542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:42.530826 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:42.531100 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:42.531756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:42.533431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:42.545790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1355/2726] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 03:59:42.550721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:42.564111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d7f60-9b45-4147-a0f0-2e2d955973d3 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:42.569371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0f96b-660d-45fc-8924-27f115416021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:42.570104 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f96b-660d-45fc-8924-27f115416021 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:42.570381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f96b-660d-45fc-8924-27f115416021 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:42.570653 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f96b-660d-45fc-8924-27f115416021 admin admin] PATH_INFO: `/v3/projects/3d0141fef03e4adc93db1f0a5bbcbe10/users/4f0e2eebb94c4bd69a0a5fcbc92997fa/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:42.572701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0f96b-660d-45fc-8924-27f115416021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0141fef03e4adc93db1f0a5bbcbe10, user_id=4f0e2eebb94c4bd69a0a5fcbc92997fa, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:42.575426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0f96b-660d-45fc-8924-27f115416021 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:42.586681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1372/2727] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:42 2022] PUT /identity/v3/projects/3d0141fef03e4adc93db1f0a5bbcbe10/users/4f0e2eebb94c4bd69a0a5fcbc92997fa/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:45.022187 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:45.024007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:45.064863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:45.102832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6284d7-c20f-452c-903f-e97b4662cc8e admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:45.176279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:45.176998 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:45.177480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:45.177895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:45.179891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:45.316882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:45.320057 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:45.339107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1356/2728] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:47.516143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042dc35-8b56-443d-b48b-68a619521ac8 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:47.516730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042dc35-8b56-443d-b48b-68a619521ac8 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:47.516730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042dc35-8b56-443d-b48b-68a619521ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:47.551257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0042dc35-8b56-443d-b48b-68a619521ac8 None None] MFA Rules not processed for user `4f0e2eebb94c4bd69a0a5fcbc92997fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:47.552646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0042dc35-8b56-443d-b48b-68a619521ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:47.631583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1373/2729] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:47.646118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:47.647742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:47.685541 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574351d3-2e8d-4edc-8672-78db8ff15925 service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:47.693467 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:47.694152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:47.694450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:47.694727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:47.766250 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:47.768029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:47.778116 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1357/2730] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:49.010177 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b664c18-e923-47a0-912e-193291853786 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:49.011080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b664c18-e923-47a0-912e-193291853786 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:49.011355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b664c18-e923-47a0-912e-193291853786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:49.031779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5b664c18-e923-47a0-912e-193291853786 None None] MFA Rules not processed for user `d8aeeb8f30ce417b875f52e2e3e85552`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:49.033296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5b664c18-e923-47a0-912e-193291853786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:49.041313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1374/2731] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:49.952293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:49.954006 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:49.984659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:50.030472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e280ef-b420-4173-9611-0fdf193a7453 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:50.035203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:50.035868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.036153 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.036433 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] PATH_INFO: `/v3/users/5ab07a5963ac4ad483b37c9949913414` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.037664 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab07a5963ac4ad483b37c9949913414)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:50.039687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:50.096226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab07a5963ac4ad483b37c9949913414'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.097069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab07a5963ac4ad483b37c9949913414'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.106572 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab07a5963ac4ad483b37c9949913414'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.107229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab07a5963ac4ad483b37c9949913414'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.124495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab07a5963ac4ad483b37c9949913414'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.137868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1358/2732] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:49 2022] DELETE /identity/v3/users/5ab07a5963ac4ad483b37c9949913414 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:50.142459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.142967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.143056 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.170434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:50.171729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:50.234634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1375/2733] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 03:59:50.244757 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:50.246311 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:50.310863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832a430-b058-4056-8cc1-91c7f015ab02 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:50.315231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d672b71-93f5-4a75-93a8-0593459d05ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:50.315859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d672b71-93f5-4a75-93a8-0593459d05ab service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.316136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d672b71-93f5-4a75-93a8-0593459d05ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.316407 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d672b71-93f5-4a75-93a8-0593459d05ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.328771 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d672b71-93f5-4a75-93a8-0593459d05ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:50.330347 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d672b71-93f5-4a75-93a8-0593459d05ab service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:50.341782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1359/2734] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:50.635901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:50.637855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:50.663547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa91b4-eb93-49a7-b42b-fa2b8c7a2571 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:50.671078 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:50.671780 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.672066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.672341 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] PATH_INFO: `/v3/projects/ece7de79c6454cafa04d3522233fcd1b` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.673575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece7de79c6454cafa04d3522233fcd1b)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:50.675626 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:50.729571 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece7de79c6454cafa04d3522233fcd1b', 'request_id': 'req-2af9dabc-c7db-404d-b703-23db604232c9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.736142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece7de79c6454cafa04d3522233fcd1b', 'request_id': 'req-2af9dabc-c7db-404d-b703-23db604232c9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.737658 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:50.745776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece7de79c6454cafa04d3522233fcd1b', 'request_id': 'req-2af9dabc-c7db-404d-b703-23db604232c9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.759520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] The token cache is being invalidate because project ece7de79c6454cafa04d3522233fcd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:50.759849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.760694 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2af9dabc-c7db-404d-b703-23db604232c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:50.762551 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1376/2735] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:50 2022] DELETE /identity/v3/projects/ece7de79c6454cafa04d3522233fcd1b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:50.768437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf25db0-7c50-47cc-bbeb-b4e82cc42fe1 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.768731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf25db0-7c50-47cc-bbeb-b4e82cc42fe1 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.769063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf25db0-7c50-47cc-bbeb-b4e82cc42fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.794759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7cf25db0-7c50-47cc-bbeb-b4e82cc42fe1 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:50.796094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7cf25db0-7c50-47cc-bbeb-b4e82cc42fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:50.838772 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:50.863066 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1360/2736] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:50.871883 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e7ba0-8ea8-4e43-8297-360edeabcaaf None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.872214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e7ba0-8ea8-4e43-8297-360edeabcaaf None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.872410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e7ba0-8ea8-4e43-8297-360edeabcaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.893471 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8f6e7ba0-8ea8-4e43-8297-360edeabcaaf None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:50.894693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8f6e7ba0-8ea8-4e43-8297-360edeabcaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:50.904540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1377/2737] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:50.908933 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf25db0-7c50-47cc-bbeb-b4e82cc42fe1 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:50.919752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf25db0-7c50-47cc-bbeb-b4e82cc42fe1 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:50.924654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:50.925323 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.925605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.925878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.926539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:50.926845 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:50.928495 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:50.945517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1361/2738] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:50.946331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e7ba0-8ea8-4e43-8297-360edeabcaaf None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:50.956631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e7ba0-8ea8-4e43-8297-360edeabcaaf None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:50.962372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:50.963172 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:50.964182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:50.964527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:50.965290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:50.967234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:51.001949 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:51.004972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1378/2739] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:50 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 03:59:51.005778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:51.008488 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:51.076134 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f845c3a-3575-4658-a5bd-fba8d0e5e5a7 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:51.084197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c9300-e32a-42c0-b5a5-9b13dede174c admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:51.089391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:51.090006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:51.090381 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:51.090553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:51.091188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:51.093331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:51.133614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1379/2740] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:51 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:51.138158 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:51.146908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bbf5a-017f-4ab7-8702-18cb501ca6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:51.147538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bbf5a-017f-4ab7-8702-18cb501ca6ba service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:51.147846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bbf5a-017f-4ab7-8702-18cb501ca6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:51.148097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bbf5a-017f-4ab7-8702-18cb501ca6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:51.150031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-421bbf5a-017f-4ab7-8702-18cb501ca6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:51.150871 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f2cc8-7ce1-4d68-be4d-f73780658eda admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:51.163276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:51.163926 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:51.164339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:51.164623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:51.165618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:51.168100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:51.184587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1380/2741] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:51.186225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:51.199053 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448a3de-16c8-4dfc-9f53-15dedb627013 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:51.205087 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:51.205959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:51.206508 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:51.207000 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:51.207944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:51.209913 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:51.222581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1381/2742] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:51.226869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:51.238788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122335b6-f5e5-46c4-ab62-504721ab028b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:51.242782 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bbf5a-017f-4ab7-8702-18cb501ca6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:51.244416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bbf5a-017f-4ab7-8702-18cb501ca6ba service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:51.245808 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:51.246553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:51.246909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:51.247253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] PATH_INFO: `/v3/projects/898c2f7239d948068dc009e637a86ca3/users/f4a2c1c5468b4fe1a6fb5f2ded425258/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:51.258041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1362/2743] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 03:59:51.265512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898c2f7239d948068dc009e637a86ca3, user_id=f4a2c1c5468b4fe1a6fb5f2ded425258, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:51.268412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:51.284990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1382/2744] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:51 2022] PUT /identity/v3/projects/898c2f7239d948068dc009e637a86ca3/users/f4a2c1c5468b4fe1a6fb5f2ded425258/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:59:51.296778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8014cd-a334-4836-a845-2a0fa7eda3c6 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:51.297047 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8014cd-a334-4836-a845-2a0fa7eda3c6 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:51.297331 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8014cd-a334-4836-a845-2a0fa7eda3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:51.351379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-bb8014cd-a334-4836-a845-2a0fa7eda3c6 None None] MFA Rules not processed for user `f4a2c1c5468b4fe1a6fb5f2ded425258`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:51.352863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bb8014cd-a334-4836-a845-2a0fa7eda3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:51.372441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:51.456647 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1363/2745] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:51.468264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:51.470445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:51.543367 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4eca1-06a6-43de-95f6-edcc5456b504 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:51.549406 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf25e0-3a21-4b62-a3f3-f7a618b34ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:51.549543 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf25e0-3a21-4b62-a3f3-f7a618b34ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:51.549748 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf25e0-3a21-4b62-a3f3-f7a618b34ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:51.550009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf25e0-3a21-4b62-a3f3-f7a618b34ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:51.565247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf25e0-3a21-4b62-a3f3-f7a618b34ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:51.566776 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf25e0-3a21-4b62-a3f3-f7a618b34ab5 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:51.572253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:51.579142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1383/2746] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:54.859188 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8014cd-a334-4836-a845-2a0fa7eda3c6 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:54.930457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8014cd-a334-4836-a845-2a0fa7eda3c6 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:54.935544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:54.936203 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:54.936479 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:54.936750 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] PATH_INFO: `/v3/users/f4a2c1c5468b4fe1a6fb5f2ded425258` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:54.937976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a2c1c5468b4fe1a6fb5f2ded425258)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:54.939895 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:54.992806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a2c1c5468b4fe1a6fb5f2ded425258'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:54.993618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a2c1c5468b4fe1a6fb5f2ded425258'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.004150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a2c1c5468b4fe1a6fb5f2ded425258'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.004863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a2c1c5468b4fe1a6fb5f2ded425258'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.017610 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a2c1c5468b4fe1a6fb5f2ded425258'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.030163 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1364/2747] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 03:59:54 2022] DELETE /identity/v3/users/f4a2c1c5468b4fe1a6fb5f2ded425258 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:55.034647 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.035186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.035186 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.054270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:55.055445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:55.115120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1384/2748] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:55.125724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:55.127403 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:55.176488 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:55.194487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327d6c1-90b0-4ecc-9aed-ee754acbd125 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:55.198414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b6b3d-5508-429e-9227-f6d22fe652a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:55.199164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6b3d-5508-429e-9227-f6d22fe652a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.199481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6b3d-5508-429e-9227-f6d22fe652a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.199763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b6b3d-5508-429e-9227-f6d22fe652a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.210012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6b3d-5508-429e-9227-f6d22fe652a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:55.211487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b6b3d-5508-429e-9227-f6d22fe652a8 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:55.222283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1365/2749] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:55.535835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:55.538412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:55.558354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61939927-cebc-46da-bf7c-a99d30a87e79 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:55.570273 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:55.571210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.571742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.572651 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] PATH_INFO: `/v3/projects/898c2f7239d948068dc009e637a86ca3` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.574321 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898c2f7239d948068dc009e637a86ca3)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:55.576852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:55.633467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898c2f7239d948068dc009e637a86ca3', 'request_id': 'req-03434121-84b8-49a7-a183-7d6e98b9e487'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.640051 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898c2f7239d948068dc009e637a86ca3', 'request_id': 'req-03434121-84b8-49a7-a183-7d6e98b9e487'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.646023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898c2f7239d948068dc009e637a86ca3', 'request_id': 'req-03434121-84b8-49a7-a183-7d6e98b9e487'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.660569 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] The token cache is being invalidate because project 898c2f7239d948068dc009e637a86ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 03:59:55.660860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.661566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-03434121-84b8-49a7-a183-7d6e98b9e487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 03:59:55.663059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1385/2750] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 03:59:55 2022] DELETE /identity/v3/projects/898c2f7239d948068dc009e637a86ca3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:55.670536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea597-ef05-44d9-a5c4-72a11566b2fc None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.670536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea597-ef05-44d9-a5c4-72a11566b2fc None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.670536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea597-ef05-44d9-a5c4-72a11566b2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.691852 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e3cea597-ef05-44d9-a5c4-72a11566b2fc None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:55.692970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e3cea597-ef05-44d9-a5c4-72a11566b2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:55.758534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1366/2751] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:55.768060 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570a76-7dbe-4976-b792-f288e007ec7d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.768347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570a76-7dbe-4976-b792-f288e007ec7d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.768631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570a76-7dbe-4976-b792-f288e007ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.789013 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-a3570a76-7dbe-4976-b792-f288e007ec7d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:55.790215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a3570a76-7dbe-4976-b792-f288e007ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:55.799213 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1386/2752] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:55.803763 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea597-ef05-44d9-a5c4-72a11566b2fc None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:55.813717 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cea597-ef05-44d9-a5c4-72a11566b2fc None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:55.818737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:55.819371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.819653 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.819926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.820618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 03:59:55.821014 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:55.822633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:55.836064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1367/2753] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 03:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 03:59:55.840831 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3570a76-7dbe-4976-b792-f288e007ec7d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:55.855481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3570a76-7dbe-4976-b792-f288e007ec7d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:55.861655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:55.862495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.862852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.863169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.863966 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:55.866428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:55.905446 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1387/2754] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:55 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:55.907315 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:55.919361 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d620e-6e2a-4bee-a1b6-1a2fe9e6c914 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:55.981748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:55.982371 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:55.982681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:55.982951 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:55.983650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:55.985693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.008978 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1368/2755] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:55 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:56.013856 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.025610 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3a084-94fd-4f4e-b0bb-c773f08b662b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.031692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.032308 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.032591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.032849 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.033528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.035243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.047271 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1388/2756] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:56.051885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.063261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f056f8-2312-4e64-b332-e21714591cfe admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.069062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af69c44-bf46-4c06-85d0-9f13f914db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.069682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af69c44-bf46-4c06-85d0-9f13f914db75 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.069966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af69c44-bf46-4c06-85d0-9f13f914db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.070240 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af69c44-bf46-4c06-85d0-9f13f914db75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.070932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af69c44-bf46-4c06-85d0-9f13f914db75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.072591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af69c44-bf46-4c06-85d0-9f13f914db75 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.085690 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1369/2757] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:56.090305 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.101344 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb73a96-748c-498d-b8f7-50c57e80359f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.106683 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.107345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.107688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.107986 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] PATH_INFO: `/v3/projects/c00feec34e394e0982d74dabd96a5cbb/users/d73a6b82e89d410abc85ffe1b2a7a5d2/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.124023 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00feec34e394e0982d74dabd96a5cbb, user_id=d73a6b82e89d410abc85ffe1b2a7a5d2, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.126727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.142921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1389/2758] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:56 2022] PUT /identity/v3/projects/c00feec34e394e0982d74dabd96a5cbb/users/d73a6b82e89d410abc85ffe1b2a7a5d2/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:56.155862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7761f5-8edc-47f9-9c06-9eca056f3459 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.156171 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7761f5-8edc-47f9-9c06-9eca056f3459 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.156440 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7761f5-8edc-47f9-9c06-9eca056f3459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.193905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-1f7761f5-8edc-47f9-9c06-9eca056f3459 None None] MFA Rules not processed for user `d73a6b82e89d410abc85ffe1b2a7a5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:56.195680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1f7761f5-8edc-47f9-9c06-9eca056f3459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:56.237276 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:56.277401 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1370/2759] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:56.282389 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.306848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:56.350894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa19bff-6fc9-4ba2-b394-0cfedfe0dffb admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.356001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.356625 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.356906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.357211 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.357851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.359758 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.389814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1390/2760] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:56 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:56.394458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7761f5-8edc-47f9-9c06-9eca056f3459 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.406527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7761f5-8edc-47f9-9c06-9eca056f3459 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.469273 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.470268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.470547 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.470816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.471473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.473444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.498806 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1371/2761] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:56 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:56.503076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.514660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f27a-1fef-47cf-8b24-4dbeff4e3905 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.520572 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.522523 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.522804 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.523080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.523733 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.525400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.538586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1391/2762] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:56.543223 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.554294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b37bd9-cb32-4b96-b1dd-5e6f6708f568 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.559699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e81f09-424a-4a7b-b21f-e87ccb6a5082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.560313 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81f09-424a-4a7b-b21f-e87ccb6a5082 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.560597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81f09-424a-4a7b-b21f-e87ccb6a5082 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.560858 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e81f09-424a-4a7b-b21f-e87ccb6a5082 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.561565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e81f09-424a-4a7b-b21f-e87ccb6a5082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.563304 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e81f09-424a-4a7b-b21f-e87ccb6a5082 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.573936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1372/2763] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:56.578602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.588977 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb1679-ed01-47af-ba80-464059870488 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.594333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.595387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.595663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.595930 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] PATH_INFO: `/v3/projects/1c535ec5efbe4d82a4f92a61309e9894/users/51955fc74278452e87438bd64336e424/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.612397 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c535ec5efbe4d82a4f92a61309e9894, user_id=51955fc74278452e87438bd64336e424, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.615233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.630860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1392/2764] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:56 2022] PUT /identity/v3/projects/1c535ec5efbe4d82a4f92a61309e9894/users/51955fc74278452e87438bd64336e424/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:56.701190 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f2c96-d698-4507-954e-509aad363c78 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.701424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f2c96-d698-4507-954e-509aad363c78 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.701656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f2c96-d698-4507-954e-509aad363c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.732497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-652f2c96-d698-4507-954e-509aad363c78 None None] MFA Rules not processed for user `51955fc74278452e87438bd64336e424`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:56.733769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-652f2c96-d698-4507-954e-509aad363c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:56.820885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1373/2765] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:56.824845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.902526 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826e91-2e44-4719-a146-cfe719c99b6b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:56.907372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:56.907988 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:56.908266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:56.908564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:56.909264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:56.911175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:56.942796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1393/2766] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 03:59:56 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:56.947241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f2c96-d698-4507-954e-509aad363c78 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:56.960164 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f2c96-d698-4507-954e-509aad363c78 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:57.020703 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:57.037140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:57.037778 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:57.038058 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:57.038341 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:57.038984 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:57.040997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:57.063996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1374/2767] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 03:59:56 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 03:59:57.068332 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:57.082067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d5ad0-9594-48ae-b526-0b9782addbfc admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:57.090327 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:57.090970 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:57.091234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:57.091512 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:57.092195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:57.093814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:57.105860 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1394/2768] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:57.110587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:57.121283 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c135c55-4f29-494c-a564-8342a272e4e2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:57.126699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:57.127398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:57.127932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:57.128211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] PATH_INFO: `/v3/projects/ed25a25105b14d81a81b4c3961f83ae8/users/d97cab0563ce4fd997168c5a08a10524/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:57.144496 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed25a25105b14d81a81b4c3961f83ae8, user_id=d97cab0563ce4fd997168c5a08a10524, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:57.147218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:57.163265 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1375/2769] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:57 2022] PUT /identity/v3/projects/ed25a25105b14d81a81b4c3961f83ae8/users/d97cab0563ce4fd997168c5a08a10524/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 03:59:57.171164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:57.182059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64492ab4-ddf3-4289-a658-ea80abef14df admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:57.227071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:57.244558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18b265-7ee7-4371-b02a-f10461a7190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:57.245202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18b265-7ee7-4371-b02a-f10461a7190e admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:57.245487 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18b265-7ee7-4371-b02a-f10461a7190e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:57.245760 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18b265-7ee7-4371-b02a-f10461a7190e admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:57.246400 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18b265-7ee7-4371-b02a-f10461a7190e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:57.248035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18b265-7ee7-4371-b02a-f10461a7190e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:57.258486 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1395/2770] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 03:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 03:59:57.262954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:57.274426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf8c58-2f42-4df5-b8ea-3e723eb02b76 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:57.281697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:57.282384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:57.282661 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:57.282937 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] PATH_INFO: `/v3/projects/ed25a25105b14d81a81b4c3961f83ae8/users/d97cab0563ce4fd997168c5a08a10524/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:57.284905 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed25a25105b14d81a81b4c3961f83ae8, user_id=d97cab0563ce4fd997168c5a08a10524, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:57.287766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:57.299441 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1376/2771] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 03:59:57 2022] PUT /identity/v3/projects/ed25a25105b14d81a81b4c3961f83ae8/users/d97cab0563ce4fd997168c5a08a10524/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 03:59:57.310107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:57.310395 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:57.310832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:57.343107 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] MFA Rules not processed for user `d97cab0563ce4fd997168c5a08a10524`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 03:59:57.345205 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:57.425268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1396/2772] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 03:59:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 03:59:57.437424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:57.439487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:57.500092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230e8f9-e962-4e0e-bf3b-4f2806d7511d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:57.504121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:57.504736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:57.505179 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:57.505452 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:57.564726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:57.566485 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:57.575892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1377/2773] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:58.126581 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:58.128083 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:58.196690 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5aa7f-7f8d-4696-b233-c7b1b59fb016 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:58.201035 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:58.201701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:58.202101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:58.202380 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:58.204462 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 03:59:58.273845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:58.275345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:58.286779 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1397/2774] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:59.125216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:59.134607 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc771-4ac9-4466-9ad2-200d409a8f3f service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:59.138329 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:59.138994 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:59.139307 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:59.139579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:59.194196 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 03:59:59.205773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:59.207400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:59.218071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1378/2775] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 03:59:59.855387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 03:59:59.870237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c2710-2705-4cfb-83eb-d1c15e215b01 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 03:59:59.875120 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 03:59:59.875996 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 03:59:59.876221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 03:59:59.876499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 03:59:59.886729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 03:59:59.888203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 03:59:59.900109 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1398/2776] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 03:59:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:01.729936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:01.731888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:01.798806 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:01.800564 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:01.812089 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=100 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:01.819003 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd2a88-b180-47a7-8c96-a639d81588ba service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:01.822442 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2d827-c26f-4385-886a-6f40208ccf02 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:01.826940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:01.827667 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:01.828016 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:01.828185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:01.828405 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:01.828834 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:01.829150 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:01.829466 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] PATH_INFO: `/v3/users/efb98c8e757344aa9b01ad32fdbb8906` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:01.830472 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:01.831215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb98c8e757344aa9b01ad32fdbb8906)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:01.833929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:01.844271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:01.846326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:01.858649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1379/2777] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:01.895915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb98c8e757344aa9b01ad32fdbb8906'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:01.897514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb98c8e757344aa9b01ad32fdbb8906'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:01.909906 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb98c8e757344aa9b01ad32fdbb8906'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:01.924413 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb98c8e757344aa9b01ad32fdbb8906'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:01.925129 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-f7e07469-90af-49b0-b4d4-9dbf785619d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb98c8e757344aa9b01ad32fdbb8906'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:01.946611 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1399/2778] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:01 2022] DELETE /identity/v3/users/efb98c8e757344aa9b01ad32fdbb8906 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:02.155216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:02.171587 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958a80-a04a-4fe1-83cf-354f37a7521b service placement] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:02.247234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:02.247878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.248258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.248631 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] PATH_INFO: `/v3/projects/bbca560419114360898754378d57ac9d` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.250524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbca560419114360898754378d57ac9d)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:02.252542 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:02.313458 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbca560419114360898754378d57ac9d', 'request_id': 'req-f82b5aa4-9719-4c06-b56f-e91da7863aab'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:02.322873 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbca560419114360898754378d57ac9d', 'request_id': 'req-f82b5aa4-9719-4c06-b56f-e91da7863aab'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:02.329206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbca560419114360898754378d57ac9d', 'request_id': 'req-f82b5aa4-9719-4c06-b56f-e91da7863aab'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:02.345798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] The token cache is being invalidate because project bbca560419114360898754378d57ac9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:02.346093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:02.346768 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f82b5aa4-9719-4c06-b56f-e91da7863aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:02.348349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1380/2779] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:02 2022] DELETE /identity/v3/projects/bbca560419114360898754378d57ac9d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:02.353465 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b137-d483-4360-bf26-e104d9e2f834 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.353790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b137-d483-4360-bf26-e104d9e2f834 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.354067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b137-d483-4360-bf26-e104d9e2f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.375956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c414b137-d483-4360-bf26-e104d9e2f834 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:02.377225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c414b137-d483-4360-bf26-e104d9e2f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:02.446592 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1400/2780] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:02.455091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93066-c192-4002-adf8-65084450023b None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.455383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93066-c192-4002-adf8-65084450023b None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.455657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93066-c192-4002-adf8-65084450023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.476596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-18e93066-c192-4002-adf8-65084450023b None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:02.477889 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-18e93066-c192-4002-adf8-65084450023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:02.486860 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1381/2781] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:02.491225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b137-d483-4360-bf26-e104d9e2f834 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:02.502011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b137-d483-4360-bf26-e104d9e2f834 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:02.506893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:02.507502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.507778 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.508047 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.508687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 04:00:02.509028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:02.510580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:02.524631 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1401/2782] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 04:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 04:00:02.529175 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93066-c192-4002-adf8-65084450023b None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:02.533832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:02.540107 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93066-c192-4002-adf8-65084450023b None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:02.546643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:02.547281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.547785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.548277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.549211 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:02.551469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:02.586810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1382/2783] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:02 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:02.590959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:02.601701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c3897-2dca-4cff-ae26-e39ac00af158 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:02.659918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:02.660540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.660821 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.661121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.661761 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:02.663813 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:02.673437 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:02.690482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1402/2784] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:02 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:02.691338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:02.702723 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad5a37-c527-478b-abdd-ea4de047e304 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:02.707507 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:02.708114 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.708392 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.708736 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.709431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:02.711186 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:02.722319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1383/2785] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:02.726514 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:02.736728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557fe40-dae5-4b79-a82e-384dd293e04e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:02.741468 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100525e8-b872-4b92-87ef-19b9fdf9768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:02.742069 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100525e8-b872-4b92-87ef-19b9fdf9768b admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.742347 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100525e8-b872-4b92-87ef-19b9fdf9768b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.742615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100525e8-b872-4b92-87ef-19b9fdf9768b admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.743253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100525e8-b872-4b92-87ef-19b9fdf9768b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:02.744827 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100525e8-b872-4b92-87ef-19b9fdf9768b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:02.758200 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1403/2786] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 04:00:02.761956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:02.773121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce3cb3-4885-4a43-ad85-c3f654120f4b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:02.778573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:02.779293 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.779566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.779832 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] PATH_INFO: `/v3/projects/215f6cf95ae1462eafde04b86da12a6b/users/ca6b2a0e349e4b0c92954abf86885009/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.795604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] RBAC: Authorizing `identity:create_grant(project_id=215f6cf95ae1462eafde04b86da12a6b, user_id=ca6b2a0e349e4b0c92954abf86885009, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:02.798480 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:02.813619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1384/2787] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:02 2022] PUT /identity/v3/projects/215f6cf95ae1462eafde04b86da12a6b/users/ca6b2a0e349e4b0c92954abf86885009/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:02.824062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84e59-2c4c-49df-a84e-5d050269bc30 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:02.824638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84e59-2c4c-49df-a84e-5d050269bc30 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:02.824747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84e59-2c4c-49df-a84e-5d050269bc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:02.854841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-64d84e59-2c4c-49df-a84e-5d050269bc30 None None] MFA Rules not processed for user `ca6b2a0e349e4b0c92954abf86885009`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:02.856142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-64d84e59-2c4c-49df-a84e-5d050269bc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:02.934279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1404/2788] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:02.939520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.002678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcffcf-f05c-4a48-8317-8f68a704556b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:03.007536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:03.008149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.008426 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.008696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.009418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:03.011459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:03.039509 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1385/2789] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:02 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:03.043793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84e59-2c4c-49df-a84e-5d050269bc30 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.055528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84e59-2c4c-49df-a84e-5d050269bc30 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:03.131071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:03.131688 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.131967 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.132241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.132873 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:03.134823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:03.159818 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1405/2790] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:03 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:03.165243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.177076 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bfbf2-57ea-40f8-b483-3a028fdb726c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:03.182777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:03.183379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.183656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.183930 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.184561 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:03.186208 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:03.197435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1386/2791] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:03.201829 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.211918 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e37d2-efef-4154-b4ed-46266dfca91e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:03.217550 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:03.218214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.218505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.218791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] PATH_INFO: `/v3/projects/b30eab584b16496fa27c806092095bc5/users/d96987dce1fa43cc93eea4d1c95c7e72/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.234858 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30eab584b16496fa27c806092095bc5, user_id=d96987dce1fa43cc93eea4d1c95c7e72, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:03.237597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:03.253623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1406/2792] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:03 2022] PUT /identity/v3/projects/b30eab584b16496fa27c806092095bc5/users/d96987dce1fa43cc93eea4d1c95c7e72/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:03.258062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.268705 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed60d49-2901-420e-9bb8-6d20e9bd5b71 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:03.326775 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa1379-832b-4596-8ff6-b55f183991a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:03.327471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1379-832b-4596-8ff6-b55f183991a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.327751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1379-832b-4596-8ff6-b55f183991a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.328019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa1379-832b-4596-8ff6-b55f183991a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.328714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1379-832b-4596-8ff6-b55f183991a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:03.330406 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa1379-832b-4596-8ff6-b55f183991a1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:03.340409 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1387/2793] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 04:00:03.345182 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.355617 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22ff36-7aa0-4c77-ba1d-88d915d5d0b5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:03.361242 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:03.362020 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.362377 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.362726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] PATH_INFO: `/v3/projects/b30eab584b16496fa27c806092095bc5/users/d96987dce1fa43cc93eea4d1c95c7e72/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.364868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30eab584b16496fa27c806092095bc5, user_id=d96987dce1fa43cc93eea4d1c95c7e72, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:03.367795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:03.379482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1407/2794] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:03 2022] PUT /identity/v3/projects/b30eab584b16496fa27c806092095bc5/users/d96987dce1fa43cc93eea4d1c95c7e72/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:03.391733 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.392035 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.392305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.421454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] MFA Rules not processed for user `d96987dce1fa43cc93eea4d1c95c7e72`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:03.422665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:03.426971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:03.491034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1388/2795] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:03.503793 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.505939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:03.533769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:03.567111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd1da-c3c2-4e2c-8d60-754d301cbf8d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:03.571464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:03.572076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:03.572354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:03.572623 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:03.582840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:03.584214 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:03.594502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1408/2796] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:03.971459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:03.973999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.043880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:04.046634 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef5ed4-ac07-4dbc-8ac6-7ba0a8a99362 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:04.051281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:04.051952 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.052258 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.052530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] PATH_INFO: `/v3/users/d73a6b82e89d410abc85ffe1b2a7a5d2` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.053760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73a6b82e89d410abc85ffe1b2a7a5d2)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:04.054358 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb47dbd-1b1f-4c63-bab3-7b98a3c69890 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:04.055680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:04.058814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:04.059433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.059714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.059989 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] PATH_INFO: `/v3/users/ca6b2a0e349e4b0c92954abf86885009` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.061314 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6b2a0e349e4b0c92954abf86885009)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:04.064027 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:04.107518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73a6b82e89d410abc85ffe1b2a7a5d2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.108131 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73a6b82e89d410abc85ffe1b2a7a5d2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.115997 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73a6b82e89d410abc85ffe1b2a7a5d2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.116632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73a6b82e89d410abc85ffe1b2a7a5d2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.117376 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6b2a0e349e4b0c92954abf86885009'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.118142 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6b2a0e349e4b0c92954abf86885009'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.125298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6b2a0e349e4b0c92954abf86885009'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.129540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-445f79a4-4db8-4b51-ad1e-873cc0b7175d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73a6b82e89d410abc85ffe1b2a7a5d2'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.134028 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6b2a0e349e4b0c92954abf86885009'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.134823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-becc2bc7-1ab4-43a1-97c4-4c9b4a5cb656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6b2a0e349e4b0c92954abf86885009'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.141957 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1389/2797] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:03 2022] DELETE /identity/v3/users/d73a6b82e89d410abc85ffe1b2a7a5d2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:04.146502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.146821 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.147220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.153590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1409/2798] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:04 2022] DELETE /identity/v3/users/ca6b2a0e349e4b0c92954abf86885009 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:04.158371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.158655 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.158919 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.170281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:04.171519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.177901 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:04.179080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.185049 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:04.234936 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1390/2799] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 04:00:04.241517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1410/2800] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:04.244868 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:04.246222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.250542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:04.251932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.293962 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:04.303674 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8957c-3aaf-4429-b49f-bce631edb62a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:04.307680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:04.308302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.308742 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.309051 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.310950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1104b-105f-4d8a-b267-595294be1d64 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:04.314560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:04.315203 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.315484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.315756 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.319248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:04.320752 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:04.324932 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:04.326478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:04.331412 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1391/2801] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 04:00:04.336152 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1411/2802] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:04.801532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:04.802878 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.807391 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:04.809017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.821252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16d49e-8177-4124-8c77-dd15c500d5fd service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:04.827477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:04.828137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.828418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.828693 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] PATH_INFO: `/v3/projects/215f6cf95ae1462eafde04b86da12a6b` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.829886 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=215f6cf95ae1462eafde04b86da12a6b)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:04.831818 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:04.846304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e22d2-0c94-442b-85cd-71281b0f6532 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:04.852189 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:04.852839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:04.853300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:04.853710 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] PATH_INFO: `/v3/projects/c00feec34e394e0982d74dabd96a5cbb` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:04.854895 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00feec34e394e0982d74dabd96a5cbb)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:04.857920 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:04.884142 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215f6cf95ae1462eafde04b86da12a6b', 'request_id': 'req-47d8621b-d518-423b-8275-a37ab388e7e7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.893459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215f6cf95ae1462eafde04b86da12a6b', 'request_id': 'req-47d8621b-d518-423b-8275-a37ab388e7e7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.899408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215f6cf95ae1462eafde04b86da12a6b', 'request_id': 'req-47d8621b-d518-423b-8275-a37ab388e7e7'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.910698 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00feec34e394e0982d74dabd96a5cbb', 'request_id': 'req-a69a8534-7e8a-4861-a170-c86fb98a1303'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.910891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] The token cache is being invalidate because project 215f6cf95ae1462eafde04b86da12a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:04.911046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.911722 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.913262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1392/2803] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:04 2022] DELETE /identity/v3/projects/215f6cf95ae1462eafde04b86da12a6b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:04.917213 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:04.918494 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.920066 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00feec34e394e0982d74dabd96a5cbb', 'request_id': 'req-a69a8534-7e8a-4861-a170-c86fb98a1303'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.925963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00feec34e394e0982d74dabd96a5cbb', 'request_id': 'req-a69a8534-7e8a-4861-a170-c86fb98a1303'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.939410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] The token cache is being invalidate because project c00feec34e394e0982d74dabd96a5cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:04.939735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.940371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:04.942164 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1412/2804] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:04 2022] DELETE /identity/v3/projects/c00feec34e394e0982d74dabd96a5cbb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:04.945992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:04.947334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:04.968071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:04.985738 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8621b-d518-423b-8275-a37ab388e7e7 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.012787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a8534-7e8a-4861-a170-c86fb98a1303 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.018253 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.018951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.019210 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.019482 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] PATH_INFO: `/v3/users/51955fc74278452e87438bd64336e424` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.020587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51955fc74278452e87438bd64336e424)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.022553 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:05.043460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.044110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.044414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.044714 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] PATH_INFO: `/v3/users/d96987dce1fa43cc93eea4d1c95c7e72` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.046018 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96987dce1fa43cc93eea4d1c95c7e72)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.048460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:05.072415 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51955fc74278452e87438bd64336e424'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.073209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51955fc74278452e87438bd64336e424'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.081604 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51955fc74278452e87438bd64336e424'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.089450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51955fc74278452e87438bd64336e424'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.090103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51955fc74278452e87438bd64336e424'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.092345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:05.101970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96987dce1fa43cc93eea4d1c95c7e72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.102662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96987dce1fa43cc93eea4d1c95c7e72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.111144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96987dce1fa43cc93eea4d1c95c7e72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.111863 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96987dce1fa43cc93eea4d1c95c7e72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.114212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1413/2805] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:04 2022] DELETE /identity/v3/users/51955fc74278452e87438bd64336e424 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:05.128883 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96987dce1fa43cc93eea4d1c95c7e72'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.142727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1393/2806] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:04 2022] DELETE /identity/v3/users/d96987dce1fa43cc93eea4d1c95c7e72 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:05.400206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:05.404188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:05.439941 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:05.441940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:05.507024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd5b13-063f-40c8-9873-858d23565f23 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.528232 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae1256-8a0f-441c-a0f5-70127d4e6b4c admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.533394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.534038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.534539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.534675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] PATH_INFO: `/v3/projects/b30eab584b16496fa27c806092095bc5` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.535734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30eab584b16496fa27c806092095bc5)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.537779 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:05.555157 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:05.572001 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.572645 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.572947 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.573279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] PATH_INFO: `/v3/projects/1c535ec5efbe4d82a4f92a61309e9894` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.574434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c535ec5efbe4d82a4f92a61309e9894)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.576738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:05.590597 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30eab584b16496fa27c806092095bc5', 'request_id': 'req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.600463 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30eab584b16496fa27c806092095bc5', 'request_id': 'req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.607669 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30eab584b16496fa27c806092095bc5', 'request_id': 'req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.619605 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] The token cache is being invalidate because project b30eab584b16496fa27c806092095bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:05.619942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.620582 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-f415ff7c-fdea-4de0-9eca-adf3e1d6604d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.622161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1394/2807] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:05 2022] DELETE /identity/v3/projects/b30eab584b16496fa27c806092095bc5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:05.626922 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e940e-8186-497f-82db-260cc20b615d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.627482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e940e-8186-497f-82db-260cc20b615d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.627766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e940e-8186-497f-82db-260cc20b615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.628274 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c535ec5efbe4d82a4f92a61309e9894', 'request_id': 'req-fe82e742-2b47-4801-b722-a7bee4acd059'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.634485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c535ec5efbe4d82a4f92a61309e9894', 'request_id': 'req-fe82e742-2b47-4801-b722-a7bee4acd059'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.640364 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c535ec5efbe4d82a4f92a61309e9894', 'request_id': 'req-fe82e742-2b47-4801-b722-a7bee4acd059'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.647369 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-889e940e-8186-497f-82db-260cc20b615d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:05.648549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-889e940e-8186-497f-82db-260cc20b615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:05.654463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] The token cache is being invalidate because project 1c535ec5efbe4d82a4f92a61309e9894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:05.654749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.655373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.656964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1414/2808] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:05 2022] DELETE /identity/v3/projects/1c535ec5efbe4d82a4f92a61309e9894 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:05.660902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:05.665695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:05.687876 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:05.709229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1395/2809] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 04:00:05.717064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b056-5b63-4441-992b-891e71e2d432 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.717349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b056-5b63-4441-992b-891e71e2d432 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.717620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b056-5b63-4441-992b-891e71e2d432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.732738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e742-2b47-4801-b722-a7bee4acd059 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.737458 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.737623 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-5791b056-5b63-4441-992b-891e71e2d432 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:05.738229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.738573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.738815 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-5791b056-5b63-4441-992b-891e71e2d432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:05.738963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] PATH_INFO: `/v3/users/d97cab0563ce4fd997168c5a08a10524` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.740322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97cab0563ce4fd997168c5a08a10524)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.742333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:05.747019 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1396/2810] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:05.751502 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b056-5b63-4441-992b-891e71e2d432 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:05.760489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b056-5b63-4441-992b-891e71e2d432 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.765773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.766516 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.766679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.766922 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.767573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 04:00:05.767879 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.769534 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:05.782054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1397/2811] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 04:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 04:00:05.786608 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:05.790408 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97cab0563ce4fd997168c5a08a10524'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.791124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97cab0563ce4fd997168c5a08a10524'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.796538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275f2a-f2b0-4646-a9ac-23200d70bddb admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.798302 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97cab0563ce4fd997168c5a08a10524'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.801900 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.802500 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.802781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.803063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.803688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.805639 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:05.808105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97cab0563ce4fd997168c5a08a10524'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.808729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97cab0563ce4fd997168c5a08a10524'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:05.828972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1415/2812] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:05 2022] DELETE /identity/v3/users/d97cab0563ce4fd997168c5a08a10524 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:05.834789 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1398/2813] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:05 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:05.840073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:05.841624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:05.910149 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a383f-47ab-4f63-9c0b-3d2e6b8716a8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:05.956300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:05.970837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:05.971453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:05.971731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:05.971999 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:05.972729 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:05.974805 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.004313 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1416/2814] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:05 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:06.008626 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.019973 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426aa83-2260-4c7f-8ee7-cb6219bdee6d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.025306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.026094 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.026216 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.026603 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.027262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.028956 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.039671 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1399/2815] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:06.043654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.054498 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a995b-72c1-4618-b303-c367aec98132 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.059276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.060019 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.060481 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.060791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.061723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.063412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.074684 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1417/2816] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:06.079069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.089948 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9de67-37b3-4632-913c-5e225f62e25b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.095117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724b13-dd0f-4cee-9805-e42d370081d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.095814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724b13-dd0f-4cee-9805-e42d370081d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.096117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724b13-dd0f-4cee-9805-e42d370081d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.096391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724b13-dd0f-4cee-9805-e42d370081d4 admin admin] PATH_INFO: `/v3/projects/480e80e9e901481a8a424f6715fab043/users/16af66ba1c4e4af6918ea875996171e9/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.113125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724b13-dd0f-4cee-9805-e42d370081d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480e80e9e901481a8a424f6715fab043, user_id=16af66ba1c4e4af6918ea875996171e9, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.115991 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724b13-dd0f-4cee-9805-e42d370081d4 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.118154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.120037 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.134594 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb662e90-5eb4-4475-82b7-4f2235cecaa8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.137460 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1400/2817] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:06 2022] PUT /identity/v3/projects/480e80e9e901481a8a424f6715fab043/users/16af66ba1c4e4af6918ea875996171e9/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:06.146688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb18e6-c4d1-4ffd-b298-a779671fe5f2 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.147069 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb18e6-c4d1-4ffd-b298-a779671fe5f2 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.147231 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb18e6-c4d1-4ffd-b298-a779671fe5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.177375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-f3fb18e6-c4d1-4ffd-b298-a779671fe5f2 None None] MFA Rules not processed for user `16af66ba1c4e4af6918ea875996171e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:06.178617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-f3fb18e6-c4d1-4ffd-b298-a779671fe5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.191185 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:06.209201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.209841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.210121 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.210393 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] PATH_INFO: `/v3/projects/ed25a25105b14d81a81b4c3961f83ae8` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.211664 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed25a25105b14d81a81b4c3961f83ae8)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.213726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.247477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1401/2818] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:06.251800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb18e6-c4d1-4ffd-b298-a779671fe5f2 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.261717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed25a25105b14d81a81b4c3961f83ae8', 'request_id': 'req-ec87b027-2d72-4345-848a-710e0a5a30b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:06.262391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb18e6-c4d1-4ffd-b298-a779671fe5f2 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.269795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed25a25105b14d81a81b4c3961f83ae8', 'request_id': 'req-ec87b027-2d72-4345-848a-710e0a5a30b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:06.275435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed25a25105b14d81a81b4c3961f83ae8', 'request_id': 'req-ec87b027-2d72-4345-848a-710e0a5a30b4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:06.290709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] The token cache is being invalidate because project ed25a25105b14d81a81b4c3961f83ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:06.291084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:06.291816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-ec87b027-2d72-4345-848a-710e0a5a30b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:06.293428 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1418/2819] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:06 2022] DELETE /identity/v3/projects/ed25a25105b14d81a81b4c3961f83ae8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:06.298455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4654-17fe-41ee-ac31-15c723096eac None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.298740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4654-17fe-41ee-ac31-15c723096eac None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.299018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c4654-17fe-41ee-ac31-15c723096eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.319017 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e71c4654-17fe-41ee-ac31-15c723096eac None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:06.320219 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e71c4654-17fe-41ee-ac31-15c723096eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.321448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.322068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.322367 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.322643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.323383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.325696 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.328383 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1419/2820] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 04:00:06.337541 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa63a-9ba0-4fc5-a6ee-0065f4af765d None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.337809 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa63a-9ba0-4fc5-a6ee-0065f4af765d None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.338101 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caa63a-9ba0-4fc5-a6ee-0065f4af765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.354677 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1402/2821] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:06.358798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.360600 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.360716 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-23caa63a-9ba0-4fc5-a6ee-0065f4af765d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:06.361909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-23caa63a-9ba0-4fc5-a6ee-0065f4af765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.407090 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:06.425615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1420/2822] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 04:00:06.429735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9706e-d1cd-418e-b81b-4c091f8e9363 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.429880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caa63a-9ba0-4fc5-a6ee-0065f4af765d None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.434822 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.435501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.435803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.436079 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.436758 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.439136 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.439432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caa63a-9ba0-4fc5-a6ee-0065f4af765d None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.444281 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.444886 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.445226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.445504 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.446148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 04:00:06.446456 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.448175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.461298 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1421/2823] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 04:00:06.462565 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1403/2824] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:06.466455 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.468356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.478063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c689d-6015-4e64-b83a-45d77a3dd788 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.478966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc048a-27bf-4a32-a992-a976119c1966 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.483567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.484183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.484339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.484520 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.484784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.484905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.485108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.485436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.485646 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.486127 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.487412 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.488129 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.499357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1422/2825] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:06.503976 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.516063 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b4f2b-70e5-4bd8-961a-33f44540336b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.517848 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1404/2826] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:06.522137 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.538570 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:06.603125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a88f9-dadd-4b36-bf86-d348302b751b admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.605041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.605730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.606479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.606479 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] PATH_INFO: `/v3/projects/afafcfc262844e438bcc5a99935c7259/users/6ed4aaa9e93247de8d7025876bf44a80/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.609146 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.610899 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.611222 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.611624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.612319 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.614519 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.621668 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=afafcfc262844e438bcc5a99935c7259, user_id=6ed4aaa9e93247de8d7025876bf44a80, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.624596 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.641140 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1405/2828] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:06.643663 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1423/2828] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:06 2022] PUT /identity/v3/projects/afafcfc262844e438bcc5a99935c7259/users/6ed4aaa9e93247de8d7025876bf44a80/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:06.644951 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.645229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.656383 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55faab-9857-4f60-90dd-e900fb16f0f0 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.711509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26085bc-28b2-4748-a763-440291025cef admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.716721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.717484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.717867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.718215 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.718944 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.719368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.720393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.720766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.721125 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.721226 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.721888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.723625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.732450 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1424/2829] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:06.734067 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1406/2830] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:06.736194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.741888 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.747706 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e8625-b494-452b-aabb-d858e7e7be10 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.753064 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645081d9-b98a-41e1-baf7-26a7566d12d1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.753296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.753904 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.754206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.754485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.755128 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.756721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.759537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debc7c6-e244-464d-9e1d-a4603117e9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.760457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc7c6-e244-464d-9e1d-a4603117e9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.760989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc7c6-e244-464d-9e1d-a4603117e9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.761489 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debc7c6-e244-464d-9e1d-a4603117e9b7 admin admin] PATH_INFO: `/v3/projects/afafcfc262844e438bcc5a99935c7259/users/6ed4aaa9e93247de8d7025876bf44a80/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.763790 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debc7c6-e244-464d-9e1d-a4603117e9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afafcfc262844e438bcc5a99935c7259, user_id=6ed4aaa9e93247de8d7025876bf44a80, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.766830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debc7c6-e244-464d-9e1d-a4603117e9b7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.768855 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1425/2831] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 04:00:06.772765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.780284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1407/2832] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:06 2022] PUT /identity/v3/projects/afafcfc262844e438bcc5a99935c7259/users/6ed4aaa9e93247de8d7025876bf44a80/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:06.784402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7fc02-34c6-4ba4-85c0-ec4c0ed8e6e5 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:06.793009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.793368 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.794221 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.829424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] MFA Rules not processed for user `6ed4aaa9e93247de8d7025876bf44a80`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:06.830954 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.833240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:06.864897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1394a-89e8-4fbf-929e-5b3b0d17b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:06.865790 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1394a-89e8-4fbf-929e-5b3b0d17b302 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.866202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1394a-89e8-4fbf-929e-5b3b0d17b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.866585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1394a-89e8-4fbf-929e-5b3b0d17b302 admin admin] PATH_INFO: `/v3/projects/8b7e05b42f6041f8bd9089a0e9376ab1/users/e7ed547576314698937936c5c43a0b74/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.884575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1394a-89e8-4fbf-929e-5b3b0d17b302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7e05b42f6041f8bd9089a0e9376ab1, user_id=e7ed547576314698937936c5c43a0b74, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:06.888685 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1394a-89e8-4fbf-929e-5b3b0d17b302 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:06.905866 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1426/2833] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:06 2022] PUT /identity/v3/projects/8b7e05b42f6041f8bd9089a0e9376ab1/users/e7ed547576314698937936c5c43a0b74/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:06.908511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1408/2834] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:06.916241 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:06.916542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:06.916815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:06.920015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:06.922342 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.934251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:06.949795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] MFA Rules not processed for user `e7ed547576314698937936c5c43a0b74`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:06.951181 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:06.990045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5479-c648-45b7-b816-7c92d5f7b5d5 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:07.030319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1427/2835] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:07.038791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:07.040464 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:07.045036 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd249e-f642-4579-b43d-451d39c9629f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:07.045756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd249e-f642-4579-b43d-451d39c9629f service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:07.046103 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd249e-f642-4579-b43d-451d39c9629f service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:07.046444 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd249e-f642-4579-b43d-451d39c9629f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:07.055223 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46e2c1-cdda-4e88-80a3-081c5bd65796 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:07.059960 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:07.060728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:07.061220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:07.061608 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:07.071155 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:07.072641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:07.082570 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1428/2836] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 04:00:07.121267 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd249e-f642-4579-b43d-451d39c9629f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:07.123252 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd249e-f642-4579-b43d-451d39c9629f service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:07.135633 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1409/2837] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:07.210249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:07.287965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c63a1-5be6-4e58-b4b3-569dc0566fae service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:07.293130 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:07.293922 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:07.294207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:07.294534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] PATH_INFO: `/v3/users/16af66ba1c4e4af6918ea875996171e9` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:07.295717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16af66ba1c4e4af6918ea875996171e9)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:07.297676 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:07.342738 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:07.354117 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16af66ba1c4e4af6918ea875996171e9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:07.354972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16af66ba1c4e4af6918ea875996171e9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:07.364835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16af66ba1c4e4af6918ea875996171e9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:07.382410 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16af66ba1c4e4af6918ea875996171e9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:07.389787 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16af66ba1c4e4af6918ea875996171e9'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:07.411519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1429/2838] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:07 2022] DELETE /identity/v3/users/16af66ba1c4e4af6918ea875996171e9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:07.416220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:07.416505 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:07.416776 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:07.442063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:07.443624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:07.497093 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:07.498963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:07.594686 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd44c4-b20d-46ae-ab4f-c9c887568a3f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:07.600243 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:07.601124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:07.601409 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:07.601679 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:07.603579 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:07.618297 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:07.620257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:07.631447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1430/2839] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:07.653709 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1410/2840] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:07.664160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:07.665705 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:07.729469 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5b19-bf7e-4eb8-8054-f3bbdb905bfa service placement] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:07.733753 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:07.734368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:07.734652 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:07.734931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:07.744814 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:07.746285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:07.756432 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1431/2841] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:08.061281 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:08.063092 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:08.077638 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28efc58-f6e9-4e8f-85c1-d0be0bb7757d None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:08.084093 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:08.085002 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:08.085389 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:08.085726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] PATH_INFO: `/v3/projects/480e80e9e901481a8a424f6715fab043` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:08.087150 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480e80e9e901481a8a424f6715fab043)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:08.089321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:08.099038 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:08.147097 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480e80e9e901481a8a424f6715fab043', 'request_id': 'req-92b68922-4003-4388-aa47-5b862a826c37'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.158800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480e80e9e901481a8a424f6715fab043', 'request_id': 'req-92b68922-4003-4388-aa47-5b862a826c37'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.166611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480e80e9e901481a8a424f6715fab043', 'request_id': 'req-92b68922-4003-4388-aa47-5b862a826c37'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.178794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] The token cache is being invalidate because project 480e80e9e901481a8a424f6715fab043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:08.179082 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.179810 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.181427 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1411/2842] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:08 2022] DELETE /identity/v3/projects/480e80e9e901481a8a424f6715fab043 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:08.185820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:08.195638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19c052-b7d4-4c62-a4a5-4dc8814e02c0 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:08.240880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:08.257483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:08.258185 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:08.258417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:08.258695 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] PATH_INFO: `/v3/users/6ed4aaa9e93247de8d7025876bf44a80` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:08.259867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed4aaa9e93247de8d7025876bf44a80)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:08.261842 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:08.316614 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed4aaa9e93247de8d7025876bf44a80'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.317373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed4aaa9e93247de8d7025876bf44a80'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.324839 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed4aaa9e93247de8d7025876bf44a80'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.334637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed4aaa9e93247de8d7025876bf44a80'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.335379 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-3225b1b2-3917-45f5-b443-9d668a297fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed4aaa9e93247de8d7025876bf44a80'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.353384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1432/2843] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:08 2022] DELETE /identity/v3/users/6ed4aaa9e93247de8d7025876bf44a80 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:08.729384 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:08.730846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:08.752828 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b68922-4003-4388-aa47-5b862a826c37 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:08.857665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:08.858351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:08.859314 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:08.859599 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] PATH_INFO: `/v3/projects/afafcfc262844e438bcc5a99935c7259` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:08.861616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afafcfc262844e438bcc5a99935c7259)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:08.864724 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:08.929402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afafcfc262844e438bcc5a99935c7259', 'request_id': 'req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.942576 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afafcfc262844e438bcc5a99935c7259', 'request_id': 'req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.949747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afafcfc262844e438bcc5a99935c7259', 'request_id': 'req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.962098 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] The token cache is being invalidate because project afafcfc262844e438bcc5a99935c7259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:08.962402 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.963143 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-92b7f51d-11c2-4ca7-b85f-cbf7230299c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:08.964793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1412/2844] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:08 2022] DELETE /identity/v3/projects/afafcfc262844e438bcc5a99935c7259 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:08.970235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbdb21-8803-4c83-baa5-506f6304cc8e None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:08.970769 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbdb21-8803-4c83-baa5-506f6304cc8e None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:08.971254 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbdb21-8803-4c83-baa5-506f6304cc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:08.994718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-84bbdb21-8803-4c83-baa5-506f6304cc8e None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:08.996039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-84bbdb21-8803-4c83-baa5-506f6304cc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:09.077916 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1433/2845] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:09.086030 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41550-0172-4420-b5e7-377efb817297 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.086511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41550-0172-4420-b5e7-377efb817297 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.086612 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba41550-0172-4420-b5e7-377efb817297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.113210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-8ba41550-0172-4420-b5e7-377efb817297 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:09.114424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8ba41550-0172-4420-b5e7-377efb817297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:09.125257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1413/2846] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:09.128540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbdb21-8803-4c83-baa5-506f6304cc8e None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.152113 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbdb21-8803-4c83-baa5-506f6304cc8e None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.170322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.171266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.171266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.171266 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.171785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 04:00:09.172088 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.175029 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.195319 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1434/2847] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 04:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 04:00:09.200611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba41550-0172-4420-b5e7-377efb817297 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.212471 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba41550-0172-4420-b5e7-377efb817297 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.217604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.218640 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.218773 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.218943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.220374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.222632 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.248716 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:09.258357 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1414/2848] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:09 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:09.263333 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.276565 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255607c3-260b-45c9-82b8-0d954cafb49b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.329030 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:09.340692 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.341370 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.341933 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.342268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.342917 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.345948 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.372485 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1435/2849] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:09 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:09.376351 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.387511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ab96-8526-48c2-93cf-e8dd6582b259 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.392659 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.393320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.393596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.393870 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.394524 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.396139 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.407034 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1415/2850] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 04:00:09.411111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.421585 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8bafa-21db-487a-bb72-c1d60c28168f admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.427475 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642b350-08e3-4748-bcf3-adbc9eee1620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.428103 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642b350-08e3-4748-bcf3-adbc9eee1620 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.428373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642b350-08e3-4748-bcf3-adbc9eee1620 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.430022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642b350-08e3-4748-bcf3-adbc9eee1620 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.430022 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642b350-08e3-4748-bcf3-adbc9eee1620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.430905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642b350-08e3-4748-bcf3-adbc9eee1620 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.444084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1436/2851] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 04:00:09.448420 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.459537 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621b20c-9a09-42d5-9bb3-d83b3f4a9623 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.464596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.465302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.466007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.466007 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] PATH_INFO: `/v3/projects/9bb05c490552479a8af5941dae6482bd/users/099bd5c1a7eb4e439b4ac8463b74a7c4/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.494424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb05c490552479a8af5941dae6482bd, user_id=099bd5c1a7eb4e439b4ac8463b74a7c4, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.499118 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.526945 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1416/2852] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:09 2022] PUT /identity/v3/projects/9bb05c490552479a8af5941dae6482bd/users/099bd5c1a7eb4e439b4ac8463b74a7c4/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:09.528434 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8f0cd-7f6e-4a0d-b435-6b6f9167f293 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.528791 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8f0cd-7f6e-4a0d-b435-6b6f9167f293 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.529299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8f0cd-7f6e-4a0d-b435-6b6f9167f293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.564388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-1ce8f0cd-7f6e-4a0d-b435-6b6f9167f293 None None] MFA Rules not processed for user `099bd5c1a7eb4e439b4ac8463b74a7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:09.565845 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1ce8f0cd-7f6e-4a0d-b435-6b6f9167f293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:09.572183 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.573649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:09.638054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cc4b0-0d2f-49e9-8751-bdcb5054a449 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.641912 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.642650 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.643027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.643393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.644953 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1437/2853] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 04:00:09.645400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:09.648240 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8f0cd-7f6e-4a0d-b435-6b6f9167f293 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.658113 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.659697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.670387 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1417/2854] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:09.714143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8f0cd-7f6e-4a0d-b435-6b6f9167f293 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.734401 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.735771 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.736290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.736634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.737378 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.739681 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.775910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1438/2855] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:09 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:09.780558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.792044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af092832-2bfb-4b1f-87dc-1212b781083e service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.857781 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.858530 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.858816 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.859074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.859707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.861741 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.889972 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1418/2856] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:09 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:09.891369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.902535 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14768bc0-7912-4f3c-aec9-3847af9420b8 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.909119 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.909735 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.910009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.910276 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.910909 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.912517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.927279 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1439/2857] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:09.928518 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:09.939784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756ca95-0912-46c8-8000-1d5af873f4c2 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:09.944799 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:09.945330 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:09.945611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:09.945885 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] PATH_INFO: `/v3/projects/c21fcda0f9c447d2837fc858922ec3b1/users/9686e546bc734235b410c9f841a63b29/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:09.961786 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21fcda0f9c447d2837fc858922ec3b1, user_id=9686e546bc734235b410c9f841a63b29, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:09.964448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:09.980149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1419/2858] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:09 2022] PUT /identity/v3/projects/c21fcda0f9c447d2837fc858922ec3b1/users/9686e546bc734235b410c9f841a63b29/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:09.984747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:10.009008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba6624-fb01-494e-a4f6-13d22a4517dd admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:10.031074 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:10.061431 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe5e7b-ab93-431c-81e0-8fe8bca8aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:10.062067 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5e7b-ab93-431c-81e0-8fe8bca8aad0 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:10.062349 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5e7b-ab93-431c-81e0-8fe8bca8aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:10.062628 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe5e7b-ab93-431c-81e0-8fe8bca8aad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:10.063268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe5e7b-ab93-431c-81e0-8fe8bca8aad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:10.064881 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe5e7b-ab93-431c-81e0-8fe8bca8aad0 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:10.075310 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1440/2859] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 04:00:10.079616 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:10.090349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce33f9c-1c33-4f87-9dd3-1910991ac3b0 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:10.096291 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:10.097015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:10.097290 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:10.097558 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] PATH_INFO: `/v3/projects/c21fcda0f9c447d2837fc858922ec3b1/users/9686e546bc734235b410c9f841a63b29/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:10.099704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21fcda0f9c447d2837fc858922ec3b1, user_id=9686e546bc734235b410c9f841a63b29, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:10.102410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:10.115257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1420/2860] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:10 2022] PUT /identity/v3/projects/c21fcda0f9c447d2837fc858922ec3b1/users/9686e546bc734235b410c9f841a63b29/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:10.127163 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a30a-c128-4e8e-bca1-0e23db35d81c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:10.127457 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a30a-c128-4e8e-bca1-0e23db35d81c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:10.127731 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a30a-c128-4e8e-bca1-0e23db35d81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:10.156588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0df8a30a-c128-4e8e-bca1-0e23db35d81c None None] MFA Rules not processed for user `9686e546bc734235b410c9f841a63b29`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:10.157974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0df8a30a-c128-4e8e-bca1-0e23db35d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:10.237666 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1441/2861] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:10.247054 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:10.250065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:10.275999 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:10.337468 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae40d7-6563-448a-90eb-576a32550546 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:10.347081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e89bc1-e301-4ba1-83e5-836bec360e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:10.347924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e89bc1-e301-4ba1-83e5-836bec360e0c service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:10.348180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e89bc1-e301-4ba1-83e5-836bec360e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:10.348624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e89bc1-e301-4ba1-83e5-836bec360e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:10.359732 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e89bc1-e301-4ba1-83e5-836bec360e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:10.361436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e89bc1-e301-4ba1-83e5-836bec360e0c service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:10.381935 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1421/2862] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:10.530533 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a30a-c128-4e8e-bca1-0e23db35d81c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:10.602516 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a30a-c128-4e8e-bca1-0e23db35d81c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:10.608102 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:10.608757 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:10.609194 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:10.609590 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] PATH_INFO: `/v3/users/099bd5c1a7eb4e439b4ac8463b74a7c4` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:10.610785 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=099bd5c1a7eb4e439b4ac8463b74a7c4)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:10.612956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:10.663586 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099bd5c1a7eb4e439b4ac8463b74a7c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:10.664304 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099bd5c1a7eb4e439b4ac8463b74a7c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:10.672474 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099bd5c1a7eb4e439b4ac8463b74a7c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:10.674399 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:10.683532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099bd5c1a7eb4e439b4ac8463b74a7c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:10.684417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099bd5c1a7eb4e439b4ac8463b74a7c4'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:10.702587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1442/2863] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:10 2022] DELETE /identity/v3/users/099bd5c1a7eb4e439b4ac8463b74a7c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:10.707594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:10.707955 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:10.708274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:10.729178 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:10.730436 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:10.789102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1422/2864] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:10.799841 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:10.801335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:10.862212 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cf06-d7ac-4b68-ada8-fce5a2a1b21a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:10.866100 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:10.866727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:10.867009 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:10.867285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:10.876846 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:10.878357 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:10.887888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1443/2865] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:11.257682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:11.259184 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:11.272617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d651b1-93f7-4d23-a699-e56bb8f7636c None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:11.277800 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:11.278338 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:11.278624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:11.279001 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] PATH_INFO: `/v3/projects/9bb05c490552479a8af5941dae6482bd` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:11.280961 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb05c490552479a8af5941dae6482bd)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:11.282929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:11.334932 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb05c490552479a8af5941dae6482bd', 'request_id': 'req-b1adf635-99db-42f9-a5f7-2cf58121b14a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.344218 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb05c490552479a8af5941dae6482bd', 'request_id': 'req-b1adf635-99db-42f9-a5f7-2cf58121b14a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.350517 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb05c490552479a8af5941dae6482bd', 'request_id': 'req-b1adf635-99db-42f9-a5f7-2cf58121b14a'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.362536 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] The token cache is being invalidate because project 9bb05c490552479a8af5941dae6482bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:11.362824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.363475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.365015 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1423/2866] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:11 2022] DELETE /identity/v3/projects/9bb05c490552479a8af5941dae6482bd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:11.369453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:11.379798 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f758a-6008-4bfb-aa10-53cdba1d4511 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:11.443208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:11.443789 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:11.444071 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:11.444345 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] PATH_INFO: `/v3/users/9686e546bc734235b410c9f841a63b29` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:11.445566 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9686e546bc734235b410c9f841a63b29)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:11.447470 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:11.499784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9686e546bc734235b410c9f841a63b29'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.500459 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9686e546bc734235b410c9f841a63b29'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.508808 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9686e546bc734235b410c9f841a63b29'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.519830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9686e546bc734235b410c9f841a63b29'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.520502 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-5a7a2d23-a5cc-47be-ad4a-db5a23bbb71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9686e546bc734235b410c9f841a63b29'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.533277 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:11.544954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1444/2867] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:11 2022] DELETE /identity/v3/users/9686e546bc734235b410c9f841a63b29 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:11.828448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:11.829982 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:11.844462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adf635-99db-42f9-a5f7-2cf58121b14a admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:11.889970 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:11.907416 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:11.907995 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:11.908279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:11.908560 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] PATH_INFO: `/v3/projects/c21fcda0f9c447d2837fc858922ec3b1` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:11.909727 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21fcda0f9c447d2837fc858922ec3b1)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:11.911701 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:11.960271 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21fcda0f9c447d2837fc858922ec3b1', 'request_id': 'req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.969618 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21fcda0f9c447d2837fc858922ec3b1', 'request_id': 'req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.976041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21fcda0f9c447d2837fc858922ec3b1', 'request_id': 'req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.987769 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] The token cache is being invalidate because project c21fcda0f9c447d2837fc858922ec3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:11.988042 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.988756 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-aa7e968c-8f26-4111-a014-0a8dfc46e9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:11.990589 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1424/2868] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:11 2022] DELETE /identity/v3/projects/c21fcda0f9c447d2837fc858922ec3b1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:11.995732 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091201-e95e-40ca-9fc5-d8f13d90d7d5 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:11.996025 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091201-e95e-40ca-9fc5-d8f13d90d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:11.996335 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091201-e95e-40ca-9fc5-d8f13d90d7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.017624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-8d091201-e95e-40ca-9fc5-d8f13d90d7d5 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:12.018869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-8d091201-e95e-40ca-9fc5-d8f13d90d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:12.084583 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1445/2869] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:12.095586 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2850c-e029-473e-94d7-ac70bb2f4ddf None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.096045 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2850c-e029-473e-94d7-ac70bb2f4ddf None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.096486 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2850c-e029-473e-94d7-ac70bb2f4ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.119924 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7be2850c-e029-473e-94d7-ac70bb2f4ddf None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:12.121339 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7be2850c-e029-473e-94d7-ac70bb2f4ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:12.130619 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1425/2870] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:12.135348 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091201-e95e-40ca-9fc5-d8f13d90d7d5 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.146478 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091201-e95e-40ca-9fc5-d8f13d90d7d5 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.152575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.153234 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.153536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.153786 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.154460 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 04:00:12.154777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.156369 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.168591 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1446/2871] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 04:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 04:00:12.173229 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2850c-e029-473e-94d7-ac70bb2f4ddf None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.182574 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2850c-e029-473e-94d7-ac70bb2f4ddf None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.187658 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.188251 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.188525 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.188793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.189454 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.191360 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.221207 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1426/2872] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:12 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:12.225580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.236461 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bab8c6-5108-4004-ad32-352940671706 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.301448 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.302057 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.302334 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.302613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.303301 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.305264 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.333879 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1447/2873] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:12 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:12.335335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.346520 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2673b0d-8998-4f92-a6bf-56a7fd5a9a17 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.352374 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.353022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.353306 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.353578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.354234 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.355904 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.367630 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1427/2874] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:12.371851 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.382765 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1dbde-f799-4585-a799-53e03584bbf7 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.388368 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317dec7-d961-4ef7-af17-0f5f24e72329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.389669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317dec7-d961-4ef7-af17-0f5f24e72329 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.389954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317dec7-d961-4ef7-af17-0f5f24e72329 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.390224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317dec7-d961-4ef7-af17-0f5f24e72329 admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.390888 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317dec7-d961-4ef7-af17-0f5f24e72329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.392501 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317dec7-d961-4ef7-af17-0f5f24e72329 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.404058 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1448/2875] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:12.408326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.418921 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c0a14-24cd-4165-8693-7368960a5995 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.424044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.424774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.425135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.425424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] PATH_INFO: `/v3/projects/4ce91c9dfbac40b2bfb620f1e257a5b7/users/b516b022721e4371b0c520159fd505ee/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.440807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce91c9dfbac40b2bfb620f1e257a5b7, user_id=b516b022721e4371b0c520159fd505ee, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.443571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.458277 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1428/2876] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:12 2022] PUT /identity/v3/projects/4ce91c9dfbac40b2bfb620f1e257a5b7/users/b516b022721e4371b0c520159fd505ee/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:12.470202 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0882f-7d2a-4c84-9283-52ba6e7a993f None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.470495 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0882f-7d2a-4c84-9283-52ba6e7a993f None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.470797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0882f-7d2a-4c84-9283-52ba6e7a993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.501317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-10f0882f-7d2a-4c84-9283-52ba6e7a993f None None] MFA Rules not processed for user `b516b022721e4371b0c520159fd505ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:12.503169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-10f0882f-7d2a-4c84-9283-52ba6e7a993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:12.557770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:12.575889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1449/2877] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:12.582379 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.651617 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebbd72-c01a-46f2-a8e1-3737b002d324 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.656894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.657522 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.657802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.658071 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.658704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.660604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.676604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:12.691802 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1429/2878] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:12 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:12.695931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0882f-7d2a-4c84-9283-52ba6e7a993f None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.707050 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0882f-7d2a-4c84-9283-52ba6e7a993f None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.773076 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.773784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.774206 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.774539 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.775294 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.777445 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.802073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1450/2879] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:12 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:12.806344 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.818734 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643c8db-81a1-498f-bd7c-f0ab5391b0fa admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.824680 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.825469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.825855 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.826130 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.831324 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.833286 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.846046 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1430/2880] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:12.850197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.863959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576b196-4f41-4d33-b01e-2c4b26843930 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.869902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.870726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.871190 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.871580 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] PATH_INFO: `/v3/projects/7882b6e0fc5041e48b4df4d7b6f8bfde/users/aeba20ecb7af4c969eb2ddbedb315b03/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:12.890337 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7882b6e0fc5041e48b4df4d7b6f8bfde, user_id=aeba20ecb7af4c969eb2ddbedb315b03, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:12.896968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:12.919548 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1451/2881] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:12 2022] PUT /identity/v3/projects/7882b6e0fc5041e48b4df4d7b6f8bfde/users/aeba20ecb7af4c969eb2ddbedb315b03/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:12.923814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:12.934747 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e987-06ba-49f5-8324-830a1937ed89 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:12.998149 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaf7ad-b51d-4e3c-9370-3f610caea6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:12.999031 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf7ad-b51d-4e3c-9370-3f610caea6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:12.999321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf7ad-b51d-4e3c-9370-3f610caea6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:12.999601 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaf7ad-b51d-4e3c-9370-3f610caea6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:13.000259 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaf7ad-b51d-4e3c-9370-3f610caea6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:13.001910 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaaf7ad-b51d-4e3c-9370-3f610caea6b7 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:13.012967 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1431/2882] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:13.017848 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:13.029197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce2c5e-ac41-465f-8add-faa8fb1e17a6 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:13.034123 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:13.034830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:13.035111 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:13.035390 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] PATH_INFO: `/v3/projects/7882b6e0fc5041e48b4df4d7b6f8bfde/users/aeba20ecb7af4c969eb2ddbedb315b03/roles/eccf9f878fd447279c05a7fd1ddfcb47` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:13.037642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7882b6e0fc5041e48b4df4d7b6f8bfde, user_id=aeba20ecb7af4c969eb2ddbedb315b03, role_id=eccf9f878fd447279c05a7fd1ddfcb47)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:13.040288 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:13.051832 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1452/2883] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:13 2022] PUT /identity/v3/projects/7882b6e0fc5041e48b4df4d7b6f8bfde/users/aeba20ecb7af4c969eb2ddbedb315b03/roles/eccf9f878fd447279c05a7fd1ddfcb47 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:13.061966 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f49b4-deb4-4b6d-8f6f-22285af166fb None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:13.062336 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f49b4-deb4-4b6d-8f6f-22285af166fb None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:13.062682 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f49b4-deb4-4b6d-8f6f-22285af166fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:13.091761 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-a41f49b4-deb4-4b6d-8f6f-22285af166fb None None] MFA Rules not processed for user `aeba20ecb7af4c969eb2ddbedb315b03`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:13.093023 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a41f49b4-deb4-4b6d-8f6f-22285af166fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:13.163928 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1432/2884] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:13.175613 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:13.177426 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:13.239505 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60ea92-b12d-41df-ac3b-bd7123de7e04 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:13.243840 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d587c0-4205-4a5f-a962-4cce4b2a0b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:13.244447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d587c0-4205-4a5f-a962-4cce4b2a0b81 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:13.244725 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d587c0-4205-4a5f-a962-4cce4b2a0b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:13.245021 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d587c0-4205-4a5f-a962-4cce4b2a0b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:13.254637 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d587c0-4205-4a5f-a962-4cce4b2a0b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:13.256084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d587c0-4205-4a5f-a962-4cce4b2a0b81 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:13.265620 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1453/2885] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:13.884528 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f49b4-deb4-4b6d-8f6f-22285af166fb None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:13.950180 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f49b4-deb4-4b6d-8f6f-22285af166fb None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:13.955335 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:13.955980 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:13.956284 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:13.956555 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] PATH_INFO: `/v3/users/b516b022721e4371b0c520159fd505ee` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:13.957721 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b516b022721e4371b0c520159fd505ee)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:13.959672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:13.966202 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:14.011152 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b516b022721e4371b0c520159fd505ee'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.011829 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b516b022721e4371b0c520159fd505ee'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.020836 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b516b022721e4371b0c520159fd505ee'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.021511 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b516b022721e4371b0c520159fd505ee'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.034000 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b516b022721e4371b0c520159fd505ee'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.046246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1433/2886] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:13 2022] DELETE /identity/v3/users/b516b022721e4371b0c520159fd505ee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:14.051207 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:14.051699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:14.051699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:14.070963 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:14.072197 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:14.116861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:14.137359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1454/2887] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:14.148678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:14.150481 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:14.216017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8425-80c8-45c7-9aa0-4ad7e99d30b9 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:14.221370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:14.222033 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:14.222527 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:14.222707 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:14.236027 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:14.237766 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:14.248257 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1434/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:14.538527 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:14.540490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:14.554612 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460bf7c-a0c4-44f9-b2c7-b98b9f87585c None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:14.559654 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:14.560797 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:14.561124 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:14.561402 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] PATH_INFO: `/v3/projects/4ce91c9dfbac40b2bfb620f1e257a5b7` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:14.562575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce91c9dfbac40b2bfb620f1e257a5b7)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:14.564560 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:14.623547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce91c9dfbac40b2bfb620f1e257a5b7', 'request_id': 'req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.630361 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce91c9dfbac40b2bfb620f1e257a5b7', 'request_id': 'req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.637742 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce91c9dfbac40b2bfb620f1e257a5b7', 'request_id': 'req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.653416 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] The token cache is being invalidate because project 4ce91c9dfbac40b2bfb620f1e257a5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:14.653719 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.654384 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.656084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1455/2889] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:14 2022] DELETE /identity/v3/projects/4ce91c9dfbac40b2bfb620f1e257a5b7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:14.660262 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:14.671348 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33955b-f105-4a5d-9040-e98dde558e4e service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:14.729559 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:14.730210 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:14.730487 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:14.730762 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] PATH_INFO: `/v3/users/aeba20ecb7af4c969eb2ddbedb315b03` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:14.731875 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeba20ecb7af4c969eb2ddbedb315b03)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:14.734161 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:14.771508 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:14.788135 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeba20ecb7af4c969eb2ddbedb315b03'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.788830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeba20ecb7af4c969eb2ddbedb315b03'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.798322 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeba20ecb7af4c969eb2ddbedb315b03'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.799029 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeba20ecb7af4c969eb2ddbedb315b03'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.813358 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-25361086-0252-4cb4-ac3d-3af37825f727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeba20ecb7af4c969eb2ddbedb315b03'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:14.825958 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1435/2890] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:14 2022] DELETE /identity/v3/users/aeba20ecb7af4c969eb2ddbedb315b03 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:15.112982 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.115042 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:15.130011 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bd46c-b0c1-45ef-bdac-00a08e75ba9d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:15.191467 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:15.192096 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.192372 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.192659 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] PATH_INFO: `/v3/projects/7882b6e0fc5041e48b4df4d7b6f8bfde` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.193868 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7882b6e0fc5041e48b4df4d7b6f8bfde)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:15.195801 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:15.262889 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7882b6e0fc5041e48b4df4d7b6f8bfde', 'request_id': 'req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:15.269810 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7882b6e0fc5041e48b4df4d7b6f8bfde', 'request_id': 'req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:15.275642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7882b6e0fc5041e48b4df4d7b6f8bfde', 'request_id': 'req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:15.287730 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:15.293247 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] The token cache is being invalidate because project 7882b6e0fc5041e48b4df4d7b6f8bfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:15.293561 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:15.294235 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-0e38abb8-3f04-4d15-a654-0f9a3ff5a17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:15.297230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1456/2891] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:15 2022] DELETE /identity/v3/projects/7882b6e0fc5041e48b4df4d7b6f8bfde => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:15.302009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972455ca-299f-4077-980f-904494359a89 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.302594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972455ca-299f-4077-980f-904494359a89 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.302594 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972455ca-299f-4077-980f-904494359a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.323193 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-972455ca-299f-4077-980f-904494359a89 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:15.324478 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-972455ca-299f-4077-980f-904494359a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:15.399469 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1436/2892] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:15.401972 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9822774-eb4c-4c9c-a589-501b82558ac7 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.402417 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9822774-eb4c-4c9c-a589-501b82558ac7 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.402816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9822774-eb4c-4c9c-a589-501b82558ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.425740 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-b9822774-eb4c-4c9c-a589-501b82558ac7 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:15.426964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-b9822774-eb4c-4c9c-a589-501b82558ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:15.435168 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1457/2893] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 04:00:15.440010 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972455ca-299f-4077-980f-904494359a89 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.450372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972455ca-299f-4077-980f-904494359a89 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:15.457662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:15.458321 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.458604 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.458882 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.459554 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 04:00:15.459862 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:15.461591 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:15.476942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1437/2894] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 04:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 04:00:15.481718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9822774-eb4c-4c9c-a589-501b82558ac7 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.494575 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9822774-eb4c-4c9c-a589-501b82558ac7 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:15.501221 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:15.501921 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.502229 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.502521 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.503145 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:15.505217 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:15.536557 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1458/2895] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:15 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:15.541189 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.551457 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52729a-0f20-4e9d-a255-99ab5ffc7bc1 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:15.609268 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:15.609891 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.610173 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.610448 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] PATH_INFO: `/v3/users` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.611081 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:15.613041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:15.636280 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1438/2896] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:15 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:15.640700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.651105 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d04a5c-3642-4fce-b540-734adb1dfbd1 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:15.656010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:15.656618 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.656902 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.657220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.657893 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:15.659699 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:15.669815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1459/2897] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:15.673915 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.683728 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461d98b-0953-433a-bf09-9b6cccee1108 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:15.688353 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303524d5-00c8-4b4f-8c51-4e6ccb0e9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:15.688992 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303524d5-00c8-4b4f-8c51-4e6ccb0e9de6 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.689275 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303524d5-00c8-4b4f-8c51-4e6ccb0e9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.689546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303524d5-00c8-4b4f-8c51-4e6ccb0e9de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.690197 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303524d5-00c8-4b4f-8c51-4e6ccb0e9de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:15.691814 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303524d5-00c8-4b4f-8c51-4e6ccb0e9de6 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:15.702556 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1439/2898] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:15.706755 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.717974 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13a01c-45b7-4159-abc7-34e8ad44abdf admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:15.723573 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:15.724303 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] REQUEST_METHOD: `PUT` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.724534 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.724811 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] PATH_INFO: `/v3/projects/c75951ce356e4068913f39bbaa226757/users/a8065910cae840f5963cf8b0e70c49e1/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.740289 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75951ce356e4068913f39bbaa226757, user_id=a8065910cae840f5963cf8b0e70c49e1, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:15.743024 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:15.758616 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1460/2899] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:15 2022] PUT /identity/v3/projects/c75951ce356e4068913f39bbaa226757/users/a8065910cae840f5963cf8b0e70c49e1/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:15.831414 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:15.831675 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:15.831926 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:15.860248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:15.866475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] MFA Rules not processed for user `a8065910cae840f5963cf8b0e70c49e1`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:15.872255 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:15.963428 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1440/2900] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:15.976633 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:15.978500 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:16.040138 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434ac36-ccca-40d6-8964-3a585f01900a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:16.043826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:16.044405 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:16.044744 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:16.045041 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:16.053562 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:16.054939 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:16.063956 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1461/2901] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:16.579553 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:16.581144 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:16.659923 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da03ff-ce49-4b46-a793-03f6aa74f1f5 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:16.666670 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:16.667294 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:16.667573 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:16.667846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:16.670012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:16.683237 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:16.684839 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:16.695544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1441/2902] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:19.796079 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:19.799877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:19.865233 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd44479-dd34-40d4-94ff-b05e869f4fa3 service cinder] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:19.870483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:19.871257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:19.871638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:19.872015 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:19.874499 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:19.931343 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:19.946717 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:19.948134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:19.958639 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1462/2903] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:21.631906 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:21.633720 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:21.649062 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff14f7b-b48f-43dd-8ae7-1266fbdee209 service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:21.654665 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7a7e9-dea5-4635-9d4b-bfb05883a92c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:21.655325 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7a7e9-dea5-4635-9d4b-bfb05883a92c service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:21.655636 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7a7e9-dea5-4635-9d4b-bfb05883a92c service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:21.655916 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7a7e9-dea5-4635-9d4b-bfb05883a92c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:21.658052 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-1ef7a7e9-dea5-4635-9d4b-bfb05883a92c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:21.671759 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7a7e9-dea5-4635-9d4b-bfb05883a92c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:21.673708 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7a7e9-dea5-4635-9d4b-bfb05883a92c service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:21.687366 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1442/2904] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:29.953900 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=5 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:30.940830 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:31.006843 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783bab6-357b-4efd-9514-19036cb0b526 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:31.012270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:31.012954 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.013270 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.013547 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] PATH_INFO: `/v3/users/a8065910cae840f5963cf8b0e70c49e1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.014702 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8065910cae840f5963cf8b0e70c49e1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:31.016826 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:31.084195 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8065910cae840f5963cf8b0e70c49e1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.084877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8065910cae840f5963cf8b0e70c49e1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.092490 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8065910cae840f5963cf8b0e70c49e1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.102489 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8065910cae840f5963cf8b0e70c49e1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.103188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8065910cae840f5963cf8b0e70c49e1'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.120863 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1463/2905] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:30 2022] DELETE /identity/v3/users/a8065910cae840f5963cf8b0e70c49e1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:31.125718 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.126264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.126264 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.146400 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:31.147687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:31.211108 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1443/2906] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:31.221669 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:31.223220 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:31.283160 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cca55-8cb0-452e-8bda-9ed68719b42d admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:31.287392 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acc512-28f2-4e80-9884-2a998b10d265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:31.288006 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acc512-28f2-4e80-9884-2a998b10d265 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.288291 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acc512-28f2-4e80-9884-2a998b10d265 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.288597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acc512-28f2-4e80-9884-2a998b10d265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.298154 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acc512-28f2-4e80-9884-2a998b10d265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:31.299589 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acc512-28f2-4e80-9884-2a998b10d265 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:31.309784 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1464/2907] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:31.590491 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:31.592296 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:31.604865 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd80c7-e7e9-4568-a0b0-17804a8678d5 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:31.610206 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:31.611346 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.611346 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.611579 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] PATH_INFO: `/v3/projects/c75951ce356e4068913f39bbaa226757` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.612688 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75951ce356e4068913f39bbaa226757)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:31.615477 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:31.627989 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:31.669892 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75951ce356e4068913f39bbaa226757', 'request_id': 'req-c8b05740-b310-4236-9275-7446c4b21afe'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.678811 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75951ce356e4068913f39bbaa226757', 'request_id': 'req-c8b05740-b310-4236-9275-7446c4b21afe'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.685174 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75951ce356e4068913f39bbaa226757', 'request_id': 'req-c8b05740-b310-4236-9275-7446c4b21afe'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.697662 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] The token cache is being invalidate because project c75951ce356e4068913f39bbaa226757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:31.697963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.698646 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-c8b05740-b310-4236-9275-7446c4b21afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:31.700192 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1444/2908] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:31 2022] DELETE /identity/v3/projects/c75951ce356e4068913f39bbaa226757 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:31.705642 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676b6c3-511e-4d9c-a255-5d3e9b6c7878 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.705964 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676b6c3-511e-4d9c-a255-5d3e9b6c7878 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.706237 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676b6c3-511e-4d9c-a255-5d3e9b6c7878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.727517 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-c676b6c3-511e-4d9c-a255-5d3e9b6c7878 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:31.728737 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-c676b6c3-511e-4d9c-a255-5d3e9b6c7878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:31.747627 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:31.793582 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1465/2909] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:31.802217 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99402-b8bd-4f49-b126-e0cef1735a03 None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.802497 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99402-b8bd-4f49-b126-e0cef1735a03 None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.802767 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa99402-b8bd-4f49-b126-e0cef1735a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.823415 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-7fa99402-b8bd-4f49-b126-e0cef1735a03 None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:31.824615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7fa99402-b8bd-4f49-b126-e0cef1735a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:31.833909 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1445/2910] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:31.838317 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676b6c3-511e-4d9c-a255-5d3e9b6c7878 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:31.849447 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676b6c3-511e-4d9c-a255-5d3e9b6c7878 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:31.855010 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:31.855619 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.855929 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.856208 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] PATH_INFO: `/v3/domains` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.856854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 04:00:31.857199 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:31.858816 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:31.872062 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1466/2911] 10.222.0.13 () {58 vars in 1153 bytes} [Sat Sep 3 04:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 04:00:31.877475 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99402-b8bd-4f49-b126-e0cef1735a03 None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:31.886929 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa99402-b8bd-4f49-b126-e0cef1735a03 None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:31.892120 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:31.892713 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:31.893021 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:31.893295 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:31.893931 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:31.895846 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:31.925571 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1446/2912] 10.222.0.13 () {60 vars in 1153 bytes} [Sat Sep 3 04:00:31 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 04:00:31.930073 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:31.941122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c3f0-0caf-4696-be63-85315b0cf190 admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:32.002225 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:32.002820 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:32.003099 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:32.003371 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] PATH_INFO: `/v3/users` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:32.003992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:32.005950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:32.032497 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1467/2913] 10.222.0.13 () {60 vars in 1144 bytes} [Sat Sep 3 04:00:31 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 04:00:32.038543 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:32.049807 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4ed85-06e1-4bb5-b314-10a76f08df16 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:32.054679 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:32.055274 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:32.055549 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:32.055817 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:32.056482 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:32.058121 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:32.067916 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1447/2914] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:32.071915 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:32.082946 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcf2a2-3282-4405-84a8-f5795c74d21a admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:32.089536 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7a06e-1cc4-4cc1-9aeb-d88945d92f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:32.090147 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a06e-1cc4-4cc1-9aeb-d88945d92f3a admin admin] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:32.090433 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a06e-1cc4-4cc1-9aeb-d88945d92f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:32.090687 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a06e-1cc4-4cc1-9aeb-d88945d92f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:32.091546 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7a06e-1cc4-4cc1-9aeb-d88945d92f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:32.093530 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7a06e-1cc4-4cc1-9aeb-d88945d92f3a admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:32.109007 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1468/2915] 10.222.0.13 () {58 vars in 1122 bytes} [Sat Sep 3 04:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 04:00:32.113760 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:32.128365 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f1f7f-b40a-4cdd-b002-26e392fec5c3 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:32.135408 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:32.136238 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] REQUEST_METHOD: `PUT` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:32.136544 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:32.136838 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] PATH_INFO: `/v3/projects/3f25e99f63934ab380b5fe0784ea579e/users/af51d9ef5d5640939c406a235b7388b2/roles/ad683698d38f4826b4af8e1069955c8e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:32.152694 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f25e99f63934ab380b5fe0784ea579e, user_id=af51d9ef5d5640939c406a235b7388b2, role_id=ad683698d38f4826b4af8e1069955c8e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:32.155613 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:32.170345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1448/2916] 10.222.0.13 () {60 vars in 1483 bytes} [Sat Sep 3 04:00:32 2022] PUT /identity/v3/projects/3f25e99f63934ab380b5fe0784ea579e/users/af51d9ef5d5640939c406a235b7388b2/roles/ad683698d38f4826b4af8e1069955c8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:32.182268 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16e13-6317-4954-b52a-05053dd7d6d2 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:32.182555 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16e13-6317-4954-b52a-05053dd7d6d2 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:32.182825 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb16e13-6317-4954-b52a-05053dd7d6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:32.212148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-bdb16e13-6317-4954-b52a-05053dd7d6d2 None None] MFA Rules not processed for user `af51d9ef5d5640939c406a235b7388b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:32.213420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-bdb16e13-6317-4954-b52a-05053dd7d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:32.279914 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1469/2917] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:32.292012 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:32.293748 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:32.353352 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844195a-443c-4974-a7bd-5142bb9e84fe admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:32.357422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21baacaa1f1c4342aacda4c967a6da58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:32.358041 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:32.358320 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:32.358596 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:32.369356 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:32.371539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:32.388162 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1449/2918] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:33.784453 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1faa9-90eb-4e3c-bbd6-860627070e84 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:33.785018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1faa9-90eb-4e3c-bbd6-860627070e84 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:33.785018 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1faa9-90eb-4e3c-bbd6-860627070e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:33.806375 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-f8a1faa9-90eb-4e3c-bbd6-860627070e84 None None] MFA Rules not processed for user `af51d9ef5d5640939c406a235b7388b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:33.807588 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-f8a1faa9-90eb-4e3c-bbd6-860627070e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:33.815257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1470/2919] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:42.379853 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:42.834032 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:42.836065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:42.914550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb660d73-2708-4f38-ac7b-fab5e06c542a service cinder] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:42.928590 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:42.929345 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:42.929678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:42.930025 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] PATH_INFO: `/v3/users/e7ed547576314698937936c5c43a0b74` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:42.931241 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ed547576314698937936c5c43a0b74)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:42.933226 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:42.984784 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ed547576314698937936c5c43a0b74'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:42.985566 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ed547576314698937936c5c43a0b74'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:42.993643 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ed547576314698937936c5c43a0b74'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:42.994260 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ed547576314698937936c5c43a0b74'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:43.006657 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ed547576314698937936c5c43a0b74'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:43.018672 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1450/2920] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:42 2022] DELETE /identity/v3/users/e7ed547576314698937936c5c43a0b74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:43.023293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:43.023783 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:43.023910 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:43.048861 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:43.050542 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:43.058869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:43.117597 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1471/2921] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:43.127689 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:43.129424 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:43.190808 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ff114-f6db-412d-a496-b6c3c03fd78d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:43.194940 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:43.195575 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:43.195872 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:43.196147 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:43.208569 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:43.210793 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:43.227220 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1451/2922] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:43.511184 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:43.512714 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:43.535419 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659463-bae7-43ff-bb96-44717ef19bcf None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:43.541188 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:43.542134 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:43.542532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:43.542880 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] PATH_INFO: `/v3/projects/8b7e05b42f6041f8bd9089a0e9376ab1` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:43.544356 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7e05b42f6041f8bd9089a0e9376ab1)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:43.547388 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:43.598209 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7e05b42f6041f8bd9089a0e9376ab1', 'request_id': 'req-01edbcf2-075c-47c2-b16a-5ebd85596390'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:43.604463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7e05b42f6041f8bd9089a0e9376ab1', 'request_id': 'req-01edbcf2-075c-47c2-b16a-5ebd85596390'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:43.610201 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7e05b42f6041f8bd9089a0e9376ab1', 'request_id': 'req-01edbcf2-075c-47c2-b16a-5ebd85596390'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:43.624265 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] The token cache is being invalidate because project 8b7e05b42f6041f8bd9089a0e9376ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:43.624552 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:43.625236 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-01edbcf2-075c-47c2-b16a-5ebd85596390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:43.626867 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1472/2923] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:43 2022] DELETE /identity/v3/projects/8b7e05b42f6041f8bd9089a0e9376ab1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 04:00:47.491867 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:47.493622 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:47.533219 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:47.592205 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aee9f-9c4f-4964-bd02-4b71651d4ff0 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:47.662774 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:47.663394 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:47.663698 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:47.663968 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:47.665794 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:47.678523 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:47.680540 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:47.692704 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1452/2924] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:49.167528 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155fb3-2ef2-40d3-9e3b-2c45ff092922 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:49.168054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155fb3-2ef2-40d3-9e3b-2c45ff092922 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:49.168054 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea155fb3-2ef2-40d3-9e3b-2c45ff092922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:49.221084 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-ea155fb3-2ef2-40d3-9e3b-2c45ff092922 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:49.222322 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-ea155fb3-2ef2-40d3-9e3b-2c45ff092922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:49.287749 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1473/2925] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 04:00:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:49.343068 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:49.344649 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:49.442656 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e94eb-02d5-4fa6-bf26-51bd7ebce70b service nova] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:49.447795 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:49.448418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:49.448697 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:49.449009 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:49.457443 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:49.459061 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:49.467918 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1453/2926] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 04:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 04:00:50.018998 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58ca0-f0ef-4d94-8714-cf5ddf439712 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:50.019290 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58ca0-f0ef-4d94-8714-cf5ddf439712 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:50.019567 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc58ca0-f0ef-4d94-8714-cf5ddf439712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:50.033296 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:50.039837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-0cc58ca0-f0ef-4d94-8714-cf5ddf439712 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:50.041803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-0cc58ca0-f0ef-4d94-8714-cf5ddf439712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:50.049985 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1474/2927] 10.222.0.13 () {58 vars in 967 bytes} [Sat Sep 3 04:00:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:50.062422 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:50.073546 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bb517-cd81-4ac0-86a9-2517a32320eb service swift] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:50.078959 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:50.079550 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:50.079830 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:50.080102 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:50.088349 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:50.090017 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:50.098535 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1454/2928] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 04:00:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 04:00:50.341991 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23ad19-a9f1-405d-9a39-165959ade937 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:50.342483 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23ad19-a9f1-405d-9a39-165959ade937 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:50.342587 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23ad19-a9f1-405d-9a39-165959ade937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:50.363897 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-6e23ad19-a9f1-405d-9a39-165959ade937 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:50.365175 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6e23ad19-a9f1-405d-9a39-165959ade937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:50.373187 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1475/2929] 10.222.0.13 () {58 vars in 1009 bytes} [Sat Sep 3 04:00:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:50.385510 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:50.390859 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=100 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:00:50.397834 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac04bb-e1e6-41d5-ba43-c637e94ea565 service swift] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:50.403578 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:50.404391 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:50.404666 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:50.404965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:50.413393 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:50.414965 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:50.422803 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1455/2930] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 04:00:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 04:00:50.757224 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] REQUEST_METHOD: `POST` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:50.757513 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:50.757796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:50.778603 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.auth.core [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] MFA Rules not processed for user `f0cdc86ba2a84930b1252299feab9913`. Rule list: `[]` (Enabled: `True`). {{(pid=87939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:50.779835 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:50.787136 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1476/2931] 10.222.0.13 () {58 vars in 967 bytes} [Sat Sep 3 04:00:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:50.799404 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:50.810615 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eea7d-ebc3-4cb7-b836-2f984eb247b3 service swift] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:50.816539 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3fce6-7ffb-47b4-8294-c132f243ed61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe8b2e7f400346f3bcfdedeed017e6ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:50.817172 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3fce6-7ffb-47b4-8294-c132f243ed61 service swift] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:50.817451 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3fce6-7ffb-47b4-8294-c132f243ed61 service swift] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:50.817699 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3fce6-7ffb-47b4-8294-c132f243ed61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:50.826593 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3fce6-7ffb-47b4-8294-c132f243ed61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:50.828200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3fce6-7ffb-47b4-8294-c132f243ed61 service swift] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:50.836261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1456/2932] 10.222.0.13 () {60 vars in 1384 bytes} [Sat Sep 3 04:00:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 04:00:53.177285 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:53.178990 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:53.260080 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6491e-644f-4023-90be-2d02d0039d80 None None] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:53.268493 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:53.269420 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:53.269726 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:53.270002 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] PATH_INFO: `/v3/users/af51d9ef5d5640939c406a235b7388b2` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:53.271602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af51d9ef5d5640939c406a235b7388b2)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:53.273634 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:53.336170 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af51d9ef5d5640939c406a235b7388b2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.336877 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af51d9ef5d5640939c406a235b7388b2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.344606 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af51d9ef5d5640939c406a235b7388b2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.354689 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af51d9ef5d5640939c406a235b7388b2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.355373 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af51d9ef5d5640939c406a235b7388b2'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.373641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1477/2933] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:00:53 2022] DELETE /identity/v3/users/af51d9ef5d5640939c406a235b7388b2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:00:53.378110 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] REQUEST_METHOD: `POST` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:53.378621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:53.378621 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:53.398538 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.auth.core [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] MFA Rules not processed for user `5c585d4ca5124180a1443dfe66cd6371`. Rule list: `[]` (Enabled: `True`). {{(pid=87938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 04:00:53.399735 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:53.461731 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1457/2934] 10.222.0.13 () {58 vars in 958 bytes} [Sat Sep 3 04:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 04:00:53.472008 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:53.477059 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:53.540108 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284489f-5e49-4d6c-aee9-506f12f5002e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:53.544709 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:53.545359 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:53.545638 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:53.545912 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:53.557602 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:53.559039 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:53.573950 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1478/2935] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:00:53.759375 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:00:53.760908 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:00:53.773532 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a552f7-4d21-4e10-b99e-08b3bc6be23a None None] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:00:53.779044 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:00:53.779695 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:00:53.779976 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:00:53.780246 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] PATH_INFO: `/v3/projects/3f25e99f63934ab380b5fe0784ea579e` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:00:53.781418 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f25e99f63934ab380b5fe0784ea579e)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:00:53.783462 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:00:53.852804 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f25e99f63934ab380b5fe0784ea579e', 'request_id': 'req-7ac17f1f-ac10-427c-a57c-4d99dd59df89'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.862654 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f25e99f63934ab380b5fe0784ea579e', 'request_id': 'req-7ac17f1f-ac10-427c-a57c-4d99dd59df89'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.868765 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f25e99f63934ab380b5fe0784ea579e', 'request_id': 'req-7ac17f1f-ac10-427c-a57c-4d99dd59df89'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.880013 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] The token cache is being invalidate because project 3f25e99f63934ab380b5fe0784ea579e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:00:53.880302 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.882063 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:00:53.883620 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1458/2936] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:00:53 2022] DELETE /identity/v3/projects/3f25e99f63934ab380b5fe0784ea579e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:01:03.564484 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:01:03.877316 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:02:41.859339 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:02:41.861169 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:02:41.934712 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0951de2-5ca3-418a-8b40-37581f26e0db service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:02:42.000781 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:02:42.001435 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:02:42.001721 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:02:42.001975 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:02:42.003973 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:02:42.015320 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:02:42.016896 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:02:42.026997 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1479/2937] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:02:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:02:52.022869 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=58 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:03:01.258602 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:03:01.260248 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:03:01.321996 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac17f1f-ac10-427c-a57c-4d99dd59df89 admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:03:01.325798 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:03:01.326398 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:03:01.326673 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:03:01.326942 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:03:01.329077 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:03:01.339022 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:03:01.340450 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:03:01.349437 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1459/2938] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:03:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:03:01.480031 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:03:01.481615 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:03:01.494747 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b2511-a6cb-475f-bf52-de51e6058096 service placement] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:03:01.498905 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:03:01.499519 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:03:01.500595 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:03:01.500875 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:03:01.502701 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:03:01.512660 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:03:01.514143 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:03:01.523183 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1480/2939] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:03:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:03:02.619692 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:03:02.629261 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b2d75-8c59-4f3d-853c-9ce7e4e9efed service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:03:02.633606 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:03:02.634209 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:03:02.634493 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:03:02.634777 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:03:02.636710 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:03:02.713435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:03:02.716065 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:03:02.730243 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1460/2940] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:03:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:03:11.519700 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=6 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:03:12.725074 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=60 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:48.292148 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:48.294641 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:48.315908 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a975fd4-e4ab-4b5a-b562-1dbab093afcd service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:48.321775 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b74a8d0579ba402c8f64fa7a6bb24658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:48.322414 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:48.322693 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:48.322968 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:48.324777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:48.393331 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:48.394837 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:48.404532 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1481/2941] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:04:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:04:48.595678 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:48.605141 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563910e-96a2-466a-8297-26d3c6e38694 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:48.608824 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:48.609894 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:48.610112 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:48.610370 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:48.612195 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:48.626645 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:48.628117 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:48.639386 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1461/2942] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:04:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:04:52.363770 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:52.373878 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd74ddf-7752-4366-b84c-adabe31660e2 service nova] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:52.377558 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1a7ee9f78da46e4abe27eadb2d17b2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:52.378325 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:52.378674 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:52.378959 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:52.380718 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:52.443969 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:52.445463 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:52.455387 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1482/2943] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:04:58.634459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=6 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:58.927305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:58.928751 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:58.943624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2b2c5-5b29-49ba-8df5-68b075aa8b90 service neutron] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:58.954498 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:58.956053 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] REQUEST_METHOD: `GET` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:58.956337 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:58.956611 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:58.959095 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:58.973687 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:58.975473 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:58.988952 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:58.989592 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1462/2944] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:04:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:04:58.990728 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:59.005671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e915f-9a58-4cc5-83ad-094bba6319e9 service neutron] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:59.011795 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:59.012511 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:59.012796 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:59.013122 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] PATH_INFO: `/v3/users/d8aeeb8f30ce417b875f52e2e3e85552` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:59.014723 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8aeeb8f30ce417b875f52e2e3e85552)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:59.016788 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:59.070355 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8aeeb8f30ce417b875f52e2e3e85552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.070992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8aeeb8f30ce417b875f52e2e3e85552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.078754 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8aeeb8f30ce417b875f52e2e3e85552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.088352 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8aeeb8f30ce417b875f52e2e3e85552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.089140 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8aeeb8f30ce417b875f52e2e3e85552'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.110649 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1483/2945] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:04:58 2022] DELETE /identity/v3/users/d8aeeb8f30ce417b875f52e2e3e85552 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:04:59.287200 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:59.298907 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e170d9-20b7-4848-b91f-f14f1847a1e1 service placement] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:59.366785 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:59.367340 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:59.367624 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:59.367897 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] PATH_INFO: `/v3/projects/604c7d1f12d9411a969e02e2820df387` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:59.369124 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] RBAC: Authorizing `identity:delete_project(project_id=604c7d1f12d9411a969e02e2820df387)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:59.371326 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:59.421431 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604c7d1f12d9411a969e02e2820df387', 'request_id': 'req-922ca639-e147-44ac-8023-3602435f313d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.430971 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604c7d1f12d9411a969e02e2820df387', 'request_id': 'req-922ca639-e147-44ac-8023-3602435f313d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.436625 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604c7d1f12d9411a969e02e2820df387', 'request_id': 'req-922ca639-e147-44ac-8023-3602435f313d'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.447397 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] The token cache is being invalidate because project 604c7d1f12d9411a969e02e2820df387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:04:59.447874 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.448372 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.449943 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1463/2946] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:04:59 2022] DELETE /identity/v3/projects/604c7d1f12d9411a969e02e2820df387 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:04:59.454016 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:59.455540 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:59.465309 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:59.469452 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1867-adf3-44f8-9022-eddafa1dc91b admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:59.530671 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:59.531230 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:59.531509 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:59.531777 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] PATH_INFO: `/v3/users/4f0e2eebb94c4bd69a0a5fcbc92997fa` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:59.532931 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0e2eebb94c4bd69a0a5fcbc92997fa)` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:59.534852 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:59.584249 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0e2eebb94c4bd69a0a5fcbc92997fa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.585091 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0e2eebb94c4bd69a0a5fcbc92997fa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.593894 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0e2eebb94c4bd69a0a5fcbc92997fa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.603244 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0e2eebb94c4bd69a0a5fcbc92997fa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.603854 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.notifications [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0e2eebb94c4bd69a0a5fcbc92997fa'} {{(pid=87939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.625454 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1484/2947] 10.222.0.13 () {58 vars in 1224 bytes} [Sat Sep 3 04:04:59 2022] DELETE /identity/v3/users/4f0e2eebb94c4bd69a0a5fcbc92997fa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:04:59.801964 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Authenticating user token {{(pid=87938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:04:59.803435 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.fernet_utils [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:04:59.818410 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca639-e147-44ac-8023-3602435f313d admin admin] Validating token access rules against request {{(pid=87938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:04:59.888091 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c585d4ca5124180a1443dfe66cd6371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b003f3768dcc465bb9a5bba73f3a6b18', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:04:59.888726 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:04:59.889037 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] SCRIPT_NAME: `/identity` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:04:59.889305 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] PATH_INFO: `/v3/projects/3d0141fef03e4adc93db1f0a5bbcbe10` {{(pid=87938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:04:59.890459 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0141fef03e4adc93db1f0a5bbcbe10)` {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:04:59.892377 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] RBAC: Authorization granted {{(pid=87938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:04:59.913754 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:04:59.942963 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0141fef03e4adc93db1f0a5bbcbe10', 'request_id': 'req-028d700e-8e16-450f-8274-c8e645af5790'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.951737 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0141fef03e4adc93db1f0a5bbcbe10', 'request_id': 'req-028d700e-8e16-450f-8274-c8e645af5790'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.957681 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0141fef03e4adc93db1f0a5bbcbe10', 'request_id': 'req-028d700e-8e16-450f-8274-c8e645af5790'} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.969533 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] The token cache is being invalidate because project 3d0141fef03e4adc93db1f0a5bbcbe10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 04:04:59.969850 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.970917 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG keystone.notifications [None req-028d700e-8e16-450f-8274-c8e645af5790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 04:04:59.972501 dv-cinder-799663-12-smb devstack@keystone.service[87938]: [pid: 87938|app: 0|req: 1464/2948] 10.222.0.13 () {58 vars in 1233 bytes} [Sat Sep 3 04:04:59 2022] DELETE /identity/v3/projects/3d0141fef03e4adc93db1f0a5bbcbe10 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 04:05:09.621803 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:05:09.966279 dv-cinder-799663-12-smb devstack@keystone.service[87938]: DEBUG dbcounter [-] [87938] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 04:07:50.813992 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Authenticating user token {{(pid=87939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 04:07:50.816299 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:07:50.969965 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf8dce-f795-4033-8e6d-32dde037714e admin admin] Validating token access rules against request {{(pid=87939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 04:07:51.041624 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e17444-4950-4e5a-94a5-deff1397e480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f28767963d594fef86d3565ea7370c01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bc30de559d443f4a50b956b2df8a95b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 04:07:51.042257 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17444-4950-4e5a-94a5-deff1397e480 service placement] REQUEST_METHOD: `GET` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 04:07:51.042549 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17444-4950-4e5a-94a5-deff1397e480 service placement] SCRIPT_NAME: `/identity` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 04:07:51.042823 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e17444-4950-4e5a-94a5-deff1397e480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 04:07:51.044815 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.fernet_utils [None req-a6e17444-4950-4e5a-94a5-deff1397e480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 04:07:51.056727 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e17444-4950-4e5a-94a5-deff1397e480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 04:07:51.058354 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e17444-4950-4e5a-94a5-deff1397e480 service placement] RBAC: Authorization granted {{(pid=87939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 04:07:51.068300 dv-cinder-799663-12-smb devstack@keystone.service[87939]: [pid: 87939|app: 0|req: 1485/2949] 10.222.0.13 () {60 vars in 1365 bytes} [Sat Sep 3 04:07:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 04:08:01.064293 dv-cinder-799663-12-smb devstack@keystone.service[87939]: DEBUG dbcounter [-] [87939] Writing DB stats keystone:SELECT=89 {{(pid=87939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}